WordClockESP/README.md

407 lines
14 KiB
Markdown
Raw Normal View History

# ESP8266 React
[![Build Status](https://travis-ci.org/rjwats/esp8266-react.svg?branch=master)](https://travis-ci.org/rjwats/esp8266-react)
2019-06-02 22:52:29 +00:00
A simple, secure and extensible framework for IoT projects built on ESP8266/ESP32 platforms with responsive React front-end.
2019-06-02 22:52:29 +00:00
Designed to work with the PlatformIO IDE with [limited setup](#getting-started). Please read below for setup, build and upload instructions.
2019-06-01 09:39:57 +00:00
![Screenshots](/media/screenshots.png?raw=true "Screenshots")
2018-02-26 22:57:09 +00:00
2019-05-31 22:28:39 +00:00
## Features
2018-02-26 22:57:09 +00:00
2019-05-31 22:28:39 +00:00
Provides many of the features required for IoT projects:
2018-02-26 22:57:09 +00:00
2019-06-02 22:52:29 +00:00
* Configurable WiFi - Network scanner and WiFi configuration screen
2019-05-31 22:28:39 +00:00
* Configurable Access Point - Can be continuous or automatically enabled when WiFi connection fails
* Network Time - Synchronization with NTP
* Remote Firmware Updates - Enable secured OTA updates
* Security - Protected RESTful endpoints and a secured user interface
2018-02-26 22:57:09 +00:00
2019-05-31 22:30:29 +00:00
The back end is provided by a set of RESTful endpoints and the React based front end is responsive and scales well to various screen sizes.
2019-06-01 17:47:37 +00:00
The front end has the prerequisite manifest file and icon, so it can be added to the home screen of a mobile device if required.
## Getting Started
### Prerequisites
You will need the following before you can get started.
* [PlatformIO](https://platformio.org/) - IDE for development
2019-05-31 22:28:39 +00:00
* [Node.js](https://nodejs.org) - For building the interface with npm
2019-06-01 17:47:37 +00:00
* Bash shell, or [Git Bash](https://gitforwindows.org/) if you are under windows
2019-06-01 18:27:08 +00:00
### Building and uploading the firmware
2019-05-31 22:28:39 +00:00
Pull the project and open it in PlatformIO. PlatformIO should download the ESP8266 platform and the project library dependencies automatically.
2019-06-01 18:27:08 +00:00
The project structure is as follows:
2019-05-31 22:43:02 +00:00
2019-06-01 18:27:08 +00:00
Resource | Description
2019-05-31 22:43:02 +00:00
---- | -----------
2019-06-01 17:49:53 +00:00
[data/](data) | The file system image directory
[interface/](interface) | React based front end
2019-08-10 11:35:26 +00:00
[src/](src) | The main.cpp and demo project to get you started
2019-06-01 17:49:53 +00:00
[platformio.ini](platformio.ini) | PlatformIO project configuration file
2019-08-10 11:35:26 +00:00
[lib/framework/](lib/framework) | C++ back end for the ESP8266 device
2019-05-31 22:43:02 +00:00
2019-06-02 22:52:29 +00:00
### Building the firmware
2019-06-01 18:27:08 +00:00
2019-06-03 21:18:59 +00:00
Once the platform and libraries are downloaded the back end should successfully build within PlatformIO.
The firmware may be built by pressing the "Build" button:
![build](/media/build.png?raw=true "build")
Alternatively type the run command:
```bash
platformio run
```
2019-06-01 09:39:57 +00:00
2019-06-01 18:27:08 +00:00
#### Uploading the firmware
2019-06-02 22:52:29 +00:00
The project is configured to upload over a serial connection by default. You can change this to use OTA updates by uncommenting the relevant lines in ['platformio.ini'](platformio.ini).
2019-06-01 18:27:08 +00:00
2019-06-02 22:52:29 +00:00
The firmware may be uploaded to the device by pressing the "Upload" button:
2019-06-01 18:27:08 +00:00
2019-06-02 22:52:29 +00:00
![uploadfw](/media/uploadfw.png?raw=true "uploadfw")
Alternatively run the 'upload' target:
2019-06-01 18:27:08 +00:00
```bash
platformio run -t upload
```
### Building the interface
2019-06-01 18:27:08 +00:00
The interface has been configured with create-react-app and react-app-rewired so the build can customized for the target device. The large artefacts are gzipped and source maps and service worker are excluded from the production build. This reduces the production build to around ~200k, which easily fits on the device.
2019-06-01 18:27:08 +00:00
Change to the ['interface'](interface) directory with your bash shell (or Git Bash) and use the standard commands you would with any react app built with create-react-app:
2019-05-31 22:43:02 +00:00
#### Change to interface directory
```bash
cd interface
```
2018-02-26 22:57:09 +00:00
#### Download and install the node modules
2018-02-26 22:57:09 +00:00
```bash
npm install
2018-02-26 22:57:09 +00:00
```
2018-02-26 22:57:09 +00:00
#### Build the interface
2018-02-26 22:57:09 +00:00
```bash
npm run build
2018-02-26 22:57:09 +00:00
```
2019-06-01 17:49:53 +00:00
> **Note**: The build command will also delete the previously built interface, in the ['data/www'](data/www) directory, replacing it with the freshly built one ready to upload to the device.
2018-02-26 22:57:09 +00:00
2019-06-02 22:52:29 +00:00
#### Uploading the file system image
The compiled user interface may be uploaded to the device by pressing the "Upload File System image" button:
![uploadfs](/media/uploadfs.png?raw=true "uploadfs")
Alternatively run the 'uploadfs' target:
```bash
platformio run -t uploadfs
```
2019-06-01 18:27:08 +00:00
### Running the interface locally
2018-02-26 22:57:09 +00:00
You can run a local development server to allow you preview changes to the front end without the need to upload a file system image to the device after each change. Change to the interface directory and run the following command:
2019-05-31 22:43:02 +00:00
2018-02-26 22:57:09 +00:00
```bash
npm start
```
2019-05-31 22:43:02 +00:00
> **Note**: To run the interface locally you will need to modify the endpoint root path and enable CORS.
2018-02-26 22:57:09 +00:00
2019-06-01 18:27:08 +00:00
#### Changing the endpoint root
The endpoint root path can be found in ['interface/.env.development'](interface/.env.development), defined as the environment variable 'REACT_APP_ENDPOINT_ROOT'. This needs to be the root URL of the device running the back end, for example:
2019-06-01 13:57:00 +00:00
```js
2019-04-10 07:33:32 +00:00
REACT_APP_ENDPOINT_ROOT=http://192.168.0.6/rest/
```
2018-02-26 23:10:27 +00:00
2019-06-01 18:27:08 +00:00
#### Enabling CORS
You can enable CORS on the back end by uncommenting the -D ENABLE_CORS build flag in ['platformio.ini'](platformio.ini) then re-building and uploading the firmware to the device. The default settings assume you will be accessing the development server on the default port on [http://localhost:3000](http://localhost:3000) this can also be changed if required:
```
-D ENABLE_CORS
-D CORS_ORIGIN=\"http://localhost:3000\"
```
## Device Configuration
As well as containing the interface, the SPIFFS image (in the ['data'](data) folder) contains a JSON settings file for each of the configurable features. The config files can be found in the ['data/config'](data/config) directory:
File | Description
---- | -----------
[apSettings.json](data/config/apSettings.json) | Access point settings
[ntpSettings.json](data/config/ntpSettings.json) | NTP synchronization settings
[otaSettings.json](data/config/otaSettings.json) | OTA update configuration
[securitySettings.json](data/config/securitySettings.json) | Security settings and user credentials
[wifiSettings.json](data/config/wifiSettings.json) | WiFi connection settings
2019-06-03 20:58:07 +00:00
### Access point settings
2019-06-01 18:27:08 +00:00
The default settings configure the device to bring up an access point on start up which can be used to configure the device:
* SSID: ESP8266-React
* Password: esp-react
2019-06-03 20:58:07 +00:00
### Security settings and user credentials
The security settings and user credentials provide the following users by default:
Username | Password
-------- | --------
admin | admin
guest | guest
2019-06-03 21:18:59 +00:00
It is recommended that you change the JWT secret and user credentials from their defaults protect your device. You can do this in the user interface, or by modifying [securitySettings.json](data/config/securitySettings.json) before uploading the file system image.
2019-06-03 20:58:07 +00:00
## Building for different devices
2019-06-01 18:27:08 +00:00
This project supports ESP8266 and ESP32 platforms. To support OTA programming, enough free space to upload the new sketch and file system image will be required. It is recommended that a board with at least 2mb of flash is used.
By default, the target device is "esp12e". This is a common ESP8266 variant with 4mb of flash:
![ESP12E](/media/esp12e.jpg?raw=true "ESP12E")
The settings file ['platformio.ini'](platformio.ini) configures the platform and board:
```
[env:esp12e]
platform = espressif8266
board = esp12e
```
If you want to build for an ESP32 device, all you need to do is re-configure ['platformio.ini'](platformio.ini) with your devices settings.
![ESP32](/media/esp32.jpg?raw=true "ESP32")
Building for the common esp32 "node32s" board for example requires the following configuration:
```
[env:node32s]
platform = espressif32
board = node32s
```
2019-06-01 13:57:00 +00:00
## Customizing and theming
2019-06-03 21:40:11 +00:00
The framework, and MaterialUI allows for a reasonable degree of customization with little effort.
2019-06-01 13:57:00 +00:00
### Theming the app
2019-06-01 18:27:08 +00:00
The app can be easily themed by editing the [MaterialUI theme](https://material-ui.com/customization/themes/). Edit the theme in ['interface/src/App.js'](interface/src/App.js) as you desire:
2019-06-01 13:57:00 +00:00
```js
const theme = createMuiTheme({
palette: {
primary: red,
secondary: deepOrange,
highlight_idle: blueGrey[900],
highlight_warn: orange[500],
highlight_error: red[500],
highlight_success: green[500],
},
});
```
### Changing the app icon
2019-06-01 18:27:08 +00:00
You can replace the app icon is located at ['interface/public/app/icon.png'](interface/public/app/icon.png) with one of your preference. A 256 x 256 PNG is recommended for best compatibility.
2019-06-01 09:39:57 +00:00
2019-06-01 13:57:00 +00:00
### Changing the app name
2019-06-01 18:27:08 +00:00
The app name displayed on the login page and on the menu bar can be modified by editing the REACT_APP_NAME property in ['interface/.env'](interface/.env)
2019-06-01 13:57:00 +00:00
```js
REACT_APP_NAME=Funky IoT Project
2019-06-01 09:39:57 +00:00
```
2019-06-01 13:57:00 +00:00
2019-06-01 18:27:08 +00:00
There is also a manifest file which contains the app name to use when adding the app to a mobile device, so you may wish to also edit ['interface/public/app/manifest.json'](interface/public/app/manifest.json):
2019-06-01 13:57:00 +00:00
```json
{
"name":"Funky IoT Project",
"icons":[
{
"src":"/app/icon.png",
"sizes":"48x48 72x72 96x96 128x128 256x256"
}
],
"start_url":"/",
"display":"fullscreen",
"orientation":"any"
}
2019-06-01 09:39:57 +00:00
```
2019-08-10 11:35:26 +00:00
## Back end overview
2018-03-03 11:45:02 +00:00
2019-08-10 11:35:26 +00:00
The back end is a set of REST endpoints hosted by a [ESPAsyncWebServer](https://github.com/me-no-dev/ESPAsyncWebServer) instance. The ['lib/framework'](lib/framework) directory contains the majority of the back end code. The framework contains of a number of useful utility classes which you can use when extending it. The project also comes with a demo project to give you some help getting started.
2018-03-03 11:45:02 +00:00
2019-08-10 11:35:26 +00:00
The framework's source is split up by feature, for example [WiFiScanner.h](lib/framework/WiFiScanner.h) implements the end points for scanning for available networks where as [WiFiSettingsService.h](lib/framework/WiFiSettingsService.h) handles configuring the WiFi settings and managing the WiFi connection.
2019-08-10 11:35:26 +00:00
### Initializing the framework
The ['src/main.cpp'](src/main.cpp) file constructs the webserver and initializes the framework. You can add endpoints to the server here to support your IoT project. The main loop is also accessable so you can run your own code easily.
The following code creates the web server, esp8266React framework and the demo project instance:
```cpp
AsyncWebServer server(80);
ESP8266React framework(&SPIFFS);
DemoProject demoProject = DemoProject(&SPIFFS, framework.getSecurityManager());
```
Now in the `setup()` function the initialization is performed:
```cpp
void setup() {
// start serial and filesystem
Serial.begin(SERIAL_BAUD_RATE);
SPIFFS.begin();
// set up the framework
framework.init(&server);
// begin the demo project
demoProject.init(&server);
// start the server
server.begin();
}
```
Finally the loop calls the framework's loop function to service the frameworks features. You can add your own code in here, as shown with the demo project:
```cpp
void loop() {
// run the framework's loop function
framework.loop();
// run the demo project's loop function
demoProject.loop();
}
```
### Adding endpoints
There are some simple classes that support adding configurable services/features to the device:
Class | Description
----- | -----------
[SimpleService.h](lib/framework/SimpleService.h) | Exposes an endpoint to read and write settings as JSON. Extend this class and implement the functions which serialize the settings to/from JSON.
[SettingsService.h](lib/framework/SettingsService.h) | As above, however this class also handles persisting the settings as JSON to the file system.
[AdminSettingsService.h](lib/framework/AdminSettingsService.h) | Extends SettingsService to secure the endpoint to administrators only, the authentication predicate can be overridden if required.
The demo project shows how these can be used, explore the framework classes for more examples.
### Security features
The framework has security features to prevent unauthorized use of the device. This is driven by [SecurityManager.h](lib/framework/SecurityManager.h).
On successful authentication, the /rest/signIn endpoint issues a JWT which is then sent using Bearer Authentication. The framework come with built in predicates for verifying a users access level. The built in AuthenticationPredicates can be found in [SecurityManager.h](lib/framework/SecurityManager.h):
Predicate | Description
-------------------- | -----------
NONE_REQUIRED | No authentication is required.
2019-08-10 11:37:54 +00:00
IS_AUTHENTICATED | Any authenticated principal is permitted.
IS_ADMIN | The authenticated principal must be an admin.
2019-08-10 11:35:26 +00:00
You can use the security manager to wrap any web handler with an authentication predicate:
```cpp
server->on("/rest/someService", HTTP_GET,
_securityManager->wrapRequest(std::bind(&SomeService::someService, this, std::placeholders::_1), AuthenticationPredicates::IS_AUTHENTICATED)
);
```
Alternatively you can extend [AdminSettingsService.h](lib/framework/AdminSettingsService.h) and optionally override `getAuthenticationPredicate()` to secure an endpoint.
## Extending the framework
2018-03-03 11:45:02 +00:00
```cpp
#include <SettingsService.h>
class ExampleSettingsService : public SettingsService {
public:
2018-03-03 12:09:03 +00:00
ExampleSettingsService(AsyncWebServer* server, FS* fs)
: SettingsService(server, fs, "/exampleSettings", "/config/exampleSettings.json") {}
2018-03-03 11:45:02 +00:00
~ExampleSettingsService(){}
protected:
void readFromJsonObject(JsonObject& root) {
_username = root["username"] | "";
_password = root["password"] | "";
}
void writeToJsonObject(JsonObject& root) {
root["username"] = _username;
root["password"] = _password;
}
private:
String _username;
String _password;
};
```
2018-03-03 12:09:03 +00:00
Now this can be constructed, added to the server, and started as such:
```cpp
ExampleSettingsService exampleSettingsService = ExampleSettingsService(&server, &SPIFFS);
exampleSettingsService.begin();
```
There will now be a REST service exposed on "/exampleSettings" for reading and writing (GET/POST) the settings. Any modifications will be persisted in SPIFFS, in this case to "/config/exampleSettings.json"
2018-03-03 12:14:18 +00:00
Sometimes you need to perform an action when the settings are updated, you can achieve this by overriding the onConfigUpdated() function which gets called every time the settings are updated. You can also perform an action when the service starts by overriding the begin() function, being sure to call SettingsService::begin():
2018-03-03 12:09:03 +00:00
```cpp
void begin() {
// make sure we call super, so the settings get read!
SettingsService::begin();
reconfigureTheService();
}
void onConfigUpdated() {
reconfigureTheService();
}
void reconfigureTheService() {
// do whatever is required to react to the new settings
}
```
## Libraries Used
* [React](https://reactjs.org/)
* [Material-UI](https://material-ui-next.com/)
2019-08-10 11:35:26 +00:00
* [notistack](https://github.com/iamhosseindhv/notistack)
* [Time](https://github.com/PaulStoffregen/Time)
* [NtpClient](https://github.com/gmag11/NtpClient)
* [ArduinoJson](https://github.com/bblanchon/ArduinoJson)
* [ESPAsyncWebServer](https://github.com/me-no-dev/ESPAsyncWebServer)