base on Go Implementation of the Spacemesh protocol full node. 💾⏰💪 # [Spacemesh: A Programmable Cryptocurrency](https://spacemesh.io) [](https://github.com/spacemeshos/go-spacemesh/blob/master/LICENSE) [](https://github.com/spacemeshos/go-spacemesh/releases)  [](https://go.dev/) [](https://github.com/spacemeshos/go-spacemesh/issues?q=is%3Aissue+is%3Aopen+label%3A%22help+wanted%22) [](http://chat.spacemesh.io/) [](https://spacemesh.io) [](https://goreportcard.com/report/github.com/spacemeshos/go-spacemesh) [](https://app.bors.tech/repositories/22421) [](https://godoc.org/github.com/spacemeshos/go-spacemesh) [](https://github.com/spacemeshos/go-spacemesh/blob/develop/ci.md#ci-status) ## go-spacemesh 💾⏰💪 Thanks for your interest in this open source project. This repo is the go implementation of the [Spacemesh](https://spacemesh.io) p2p full node software. Spacemesh is a decentralized blockchain computer using a new race-free consensus protocol that doesn't involve energy-wasteful `proof of work`. We aim to create a secure and scalable decentralized computer formed by a large number of desktop PCs at home. We are designing and coding a modern blockchain platform from the ground up for scale, security and speed based on the learnings of the achievements and mistakes of previous projects in this space. To learn more about Spacemesh head over to [https://spacemesh.io](https://spacemesh.io). To learn more about the Spacemesh protocol [watch this video](https://www.youtube.com/watch?v=jvtHFOlA1GI). ### Motivation Spacemesh is designed to create a decentralized blockchain smart contracts computer and a cryptocurrency that is formed by connecting the home PCs of people from around the world into one virtual computer without incurring massive energy waste and mining pools issues that are inherent in other blockchain computers, and provide a provably-secure and incentive-compatible smart contracts execution environment. Spacemesh is designed to be ASIC-resistant and in a way that doesn’t give an unfair advantage to rich parties who can afford setting up dedicated computers on the network. We achieve this by using a novel consensus protocol and optimize the software to be most effectively be used on home PCs that are also used for interactive apps. ### What is this good for? Provide dapp and app developers with a robust way to add value exchange and other value related features to their apps at scale. Our goal is to create a truly decentralized cryptocurrency that fulfills the original vision behind bitcoin to become a secure trustless store of value as well as a transactional currency with extremely low transaction fees. ### Target Users go-spacemesh is designed to be installed and operated on users' home PCs to form one decentralized computer. It is going to be distributed in the Spacemesh App but people can also build and run it from source code. ### Project Status We are working hard towards our first major milestone - a public permissionless testnet running the Spacemesh consensus protocol. ### Contributing Thank you for considering to contribute to the go-spacemesh open source project! We welcome contributions large and small and we actively accept contributions. - go-spacemesh is part of [The Spacemesh open source project](https://spacemesh.io), and is MIT licensed open source software. - We welcome collaborators to the Spacemesh core dev team. - You don’t have to contribute code! Many important types of contributions are important for our project. See: [How to Contribute to Open Source?](https://opensource.guide/how-to-contribute/#what-it-means-to-contribute) - To get started, please read our [contributions guidelines](https://github.com/spacemeshos/go-spacemesh/blob/master/CONTRIBUTING.md). - Browse [Good First Issues](https://github.com/spacemeshos/go-spacemesh/labels/good%20first%20issue). - Get ethereum awards for your contribution by working on one of our [gitcoin funded issues](https://gitcoin.co/profile/spacemeshos). ### Diggin' Deeper Please read the Spacemesh [full FAQ](https://github.com/spacemeshos/go-spacemesh/wiki/Spacemesh-FAQ). ### go-spacemesh Architecture  ### Getting ```bash git clone [email protected]:spacemeshos/go-spacemesh.git ``` or fork the project from <https://github.com/spacemeshos/go-spacemesh> Since the project uses Go Modules it is best to place the code **outside** your `$GOPATH`. Read [this](https://github.com/golang/go/wiki/Modules#how-to-install-and-activate-module-support) for alternatives. ### Setting Up Local Dev Environment Building is supported on: - Linux, GLIBC 2.34+ is required - MacOS 13 (Intel) and MacOS 14 (Arm) and newer - Windows 10 and newer FreeBSD is not officially supported. Install [Go 1.23 or later](https://golang.org/dl/) for your platform, if you haven't already. On Windows you need to install `make` via [msys2](https://www.msys2.org/), [MingGW-w64](http://mingw-w64.org/doku.php) or [mingw](https://chocolatey.org/packages/mingw). Ensure that `$GOPATH` is set correctly and that the `$GOPATH/bin` directory appears in `$PATH`. Ensure that you have installed [git-lfs](https://git-lfs.com/). Before building we need to set up the golang environment. Do this by running: ```bash make install ``` Make sure the environment is set up correctly: ```bash make go-env-test ``` **CGO_CFLAGS** must be set to "-I<absolute_path_to_repo>/go-spacemesh/build/ -DSQLITE_ENABLE_DBSTAT_VTAB=1" **CGO_LDFLAGS** must be set to "-L<absolute_path_to_repo>/go-spacemesh/build/ -Wl,-rpath,$ORIGIN -Wl,-rpath,<absolute_path_to_repo>/go-spacemesh/build/" Make sure you have **OpenCL** library installed. To check if setup was configured successfully, try to run: ```bash make test ``` There shouldn't be any build errors, but please note that running the tests will take some time. ### How to run standalone node? After you got a binary standalone fully functional network can be launched with a simple command: > ./build/go-spacemesh --preset=standalone --genesis-time=2023-06-08T5:30:00.000Z Network will use short epochs (1 minute), and 10 layers within the epoch (each 6s). Poet is launched in the same process in this mode. So expect that it will periodically hog 1 core. Minimal smeshing is enabled in order for consensus to work. Public GRPC API are launched on 0.0.0.0:9092. Private - 0.0.0.0:9093. ### Building To build `go-spacemesh` for your current system architecture, from the project root directory, use: ```bash make build ``` (On FreeBSD, you should instead use `gmake build`. You can install `gmake` with `pkg install gmake` if it isn't already installed.) This will build the `go-spacemesh` binary, saving it in the `build/` directory. On linux or mac you can build a binary for windows using: ```bash make windows ``` Be aware that this will require a cross-platform gcc like `x86_64-w64-mingw32-gcc`. Platform-specific binaries are saved to the `build/*target*` directory. ### Using `go build` and `go test` without `make` To build or test code without using `make` some golang environment variables must be set appropriately. The environment variables can be printed by running either `make print-env` or `make print-test-env`. They can be set in 3 ways: _Note: we need to use `eval` to interpret the commands since there are spaces in the values of the variables so the shell can't correctly split them as arguments._ 1. Setting the variables on the same line as the `go` command (e.g., `eval $(make print-env) go build ./...`). This affects the environment for that command invocation only. 2. Exporting the variables in the shell's environment (e.g., `eval export $(make print-env)`). The variables will persist for the duration of that shell (and will be passed to subshells). 3. Setting the variables in the go environment (e.g., `eval go env -w $(make print-env)`). Persistently adds these values to Go's environment for any future runs. --- ### Running _Note: go-spacemesh relies on a gpu setup dynamic library in order to run. `make install` puts this file in the build folder, so if you are running spacemesh from the build folder you don't need to take any extra action. However if you have built the binary using `go build` or moved the binary from the build folder you need to ensure that you have the gpu setup dynamic library (the exact name will vary based on your OS) accessible by the go-spacemesh binary. The simplest way to do this is just copy the library file to be in the same directory as the go-spacemesh binary. Alternatively you can modify your system's library search paths (e.g. LD_LIBRARY_PATH) to ensure that the library is found. go-spacemesh is p2p software which is designed to form a decentralized network by connecting to other instances of go-spacemesh running on remote computers. To run go-spacemesh you need to specify the parameters shared between all instances on a specific network. You specify these parameters by providing go-spacemesh with a json config file. Other CLI flags control local node behavior and override default values. #### Joining a Testnet (without mining) 1. Build go-spacemesh from source code. 2. Download the testnet's json config file. Make sure your local config file suffix is `.json`. 3. Start go-spacemesh with the following arguments: ```bash ./go-spacemesh --listen [a_multiaddr] --config [configFileLocation] -d [nodeDataFilesPath] ``` **Example:** Assuming `tn1.json` is a testnet config file saved in the same directory as go-spacemesh, use the following command to join the testnet. The data folder will be created in the same directory as go-spacemesh. The node will use TCP port 7513 and UDP port 7513 for p2p connections: ```bash ./go-spacemesh --listen /ip4/0.0.0.0/tcp/7513 --config ./tn1.json -d ./sm_data ``` 4. Build the [CLI Wallet](https://github.com/spacemeshos/CLIWallet) from source code and run it: 5. Use the CLI Wallet commands to setup accounts, start smeshing and execute transactions. ```bash ./cli_wallet ``` #### Joining a Testnet (with mining) 1. Run go-spacemesh to join a testnet without mining (see above). 2. Run the CLI Wallet to create a coinbase account. Save your coinbase account public address - you'll need it later. 3. Stop go-spacemesh and start it with the following parameters: ```bash ./go-spacemesh --listen [a_multiaddr] --config [configFileLocation] -d [nodeDataFilesPath] \ --smeshing-coinbase [coinbase_account] \ --smeshing-start --smeshing-opts-datadir [dir_for_post_data] ``` **Example:** ```bash ./go-spacemesh --listen /ip4/0.0.0.0/tcp/7513 --config ./tn1.json -d ./sm_data \ --smeshing-coinbase stest1qqqqqqp3qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqql50dsa \ --smeshing-start --smeshing-opts-datadir ./post_data ``` 4. Use the CLI wallet to check your coinbase account balance and to transact --- ### Smeshing To be able to initialize your PoST using your Graphics card you will need to install the tools necessary to enable OpenCL support on your system. The exact steps to do this will vary based on your OS and GPU. In general you will need to install the OpenCL runtime for your GPU and ICD loader. A good starting point to get more info is <https://wiki.archlinux.org/title/GPGPU>. If your system doesn't have a GPU or you can use a generic runtime instead. Be aware that we do not recommend this for initialization of PoST. On Ubuntu you need to install the following packages: ```bash apt-get update apt-get install libpocl2 ``` on Windows you can use Intel OpenAPI: ```bash choco install opencl-intel-cpu-runtime ``` #### Using a remote machine as provider for PoST proofs To disable the internal PoST service and disable smeshing on your node you can use the following config: ```json "smeshing": { "smeshing-start": false, } ``` or use the `--smeshing-start=false` flag. Additionally rename the `local.key` in your `data/identities` folder to a unique name for your node (e.g. `nodeA.key`). This will disable smeshing on your node causing, i.e. it will not generate any PoST proofs until a remote post service connects. Be aware that you still need to set your coinbase via: ```json "smeshing": { "smeshing-coinbase": "your coinbase address", } ``` or use the `--smeshing-coinbase` CLI parameter, otherwise your node will not be able to receive rewards. Additionally you will have to set `grpc-post-listener` to e.g. `0.0.0.0:9094` in your `api` config to allow the remote post service to connect to your node. #### Merging multiple existing nodes into a single one with multiple remote PoST services To help in the process of merging multiple nodes into a single one, you can use `merge-nodes` tool. This tool will copy over identities and merge their local states into a single node. Ensure that all nodes are running the latest version of `go-spacemesh` and were started at least once after upgrading. We recommend to back up the `data` directory of the nodes you want to merge before running this tool to avoid data loss. Specifically the `local.sql` files and the `identities` directories. Stop the two nodes you want to merge and ensure that they have been set up for remote smeshing (i.e. `smeshing-start` is false and `local.key` has been renamed). `src` is the node that will be merged into `dst`: ```bash merge-nodes --src /path/to/src/data --dst /path/to/dst/data ``` This will copy over the identities from `src` to `dst` and merge the local states of both nodes. The command will tell you if it encounters any issues merging the identities or the local states. You can repeat this process with as many nodes as you want to merge into `dst`. After you have completed the merging process, you can start `dst`. For every identity setup a post service to use the existing PoST data for that identity and connect to the node. For details refer to the [post-service README](https://github.com/spacemeshos/post-rs/blob/main/service/README.md). #### Using a remote PoST service over insecure connections If you want to allow connections from post services over the internet to your node, we strongly recommend not to connect via `grpc-post-listener` but rather use the `grpc-tls-listener` configuration parameter and setup TLS for the connection. This is useful for example if you want to run a node on a cloud provider with fewer resources and run PoST on a local machine with more resources. The post service only needs to be online for the initial proof (i.e. when joining the network for the first time) and during the cyclegap in every epoch. To setup TLS-secured public connections the API config has been extended with the following options: ```json "api": { "grpc-tls-listener": "0.0.0.0:9094", // listen address for TLS connections "grpc-tls-ca-cert": "/path/to/ca.pem", // CA certificate that signed the node's and the PoST service's certificates "grpc-tls-cert": "/path/to/cert.pem", // certificate for the node "grpc-tls-key": "/path/to/key.pem", // private key for the node } ``` Ensure that remote PoST services are setup to connect to your node via TLS, that they trust your node's certificate and use a certificate that is signed by the same CA as your node's certificate. ### Configuring a remote PoST service The post service is at the moment configured exclusively via command line parameters: - `--dir` specifies the directory containing `postdata_metadata.json` and the `postdata_xxx.bin` files; other files in the post directory need to stay with the node! - `--address` specifies the address the post service should connect to - `--ca-cert`, `--cert` and `--key` specify the location of the CA certificate, the post services certificate and the post services key respectively. For more information see below. - `--threads`, `--nonces` and `--randomx-mode` can be adapted to optimize proof generation. They are analogous to `smeshing-opts-proving-threads`, `smeshing-opts-proving-nonces` and `smeshing-opts-proving-randomx-mode` respectively. - `-h` or `--help` prints a help message with all available options and more details on their usage. ### Keys and certificates The PoST service and the node talk to each other via mTLS and have to authenticate themselves at the opposite end. For this both need keys and certificates. Here is a script that generates a key & certificate for a CA, a key for the client (PoST service) and a key for the server (node). Then it uses the CAs key to generate certificates from the keys for both the client & server. Make sure to adjust the certificate extensions & subjects for your setup accordingly. `ca.crt` needs to be provided to both the PoST service and the node, `server.crt` & `server.key` are only needed by the node and `client.crt` & `client.key` are only needed by the PoST service. ```bash # create certificate extensions to allow using them for localhost cat > server-domains.ext <<EOF [v3_req] subjectAltName = @alt_names [alt_names] DNS.1 = node IP.1 = 127.0.0.1 EOF cat > client-domains.ext <<EOF [v3_req] subjectAltName = @alt_names [alt_names] DNS.1 = post EOF # create CA private key and certificate openssl req -x509 -newkey rsa:4096 -days 365 -nodes -keyout ca.key -out ca.crt \ -subj "/C=EN/ST=Spacemesh/L=Tel Aviv/O=Spacemesh/CN=spacemesh.io/[email protected]" # create server private key and CSR openssl req -newkey rsa:4096 -nodes -keyout server.key -out server-req.pem \ -subj "/C=EN/ST=Spacemesh/L=Tel Aviv/O=Server/CN=server.spacemesh.io/[email protected]" # use CA private key to sign ser CRS and get back the signed certificate openssl x509 -req -in server-req.pem -days 60 -CA ca.crt -CAkey ca.key -CAcreateserial -out server.crt \ -extfile server-domains.ext -extensions v3_req rm server-req.pem # create client private key and CSR openssl req -newkey rsa:4096 -nodes -keyout client.key -out client-req.pem \ -subj "/C=EN/ST=Spacemesh/L=Tel Aviv/O=Client/CN=client.spacemesh.io/[email protected]" \ # use CA private key to sign client CSR and get back the signed certificate openssl x509 -req -in client-req.pem -days 60 -CA ca.crt -CAkey ca.key -CAcreateserial -out client.crt \ -extfile client-domains.ext -extensions v3_req rm client-req.pem ``` --- ### Testing _NOTE_: if tests are hanging try running `ulimit -n 400`. some tests require that to work. ```bash TEST_LOG_LEVEL="" make test ``` The optional `TEST_LOG_LEVEL` environment variable can be set to change the log level during test execution. If not set, tests won't print any logs. Valid values are the error levels of [zapcore](https://pkg.go.dev/go.uber.org/zap/zapcore#Level) For code coverage you can run: ```bash make cover ``` This will start a local web service and open your browser to render a coverage report. If you just want to generate a cover profile you can run: ```bash make cover-profile ``` The generated file will be saved to `./cover.out`. It can be loaded into your editor or IDE to view which code paths are covered by tests and which not. ### Continuous Integration We've enabled continuous integration on this repository in GitHub. You can see more details about our CI workflows on the [Actions tab](https://github.com/spacemeshos/go-spacemesh/actions). ### Docker A `Dockerfile` is included in the project allowing anyone to build and run a docker image: ```bash docker build -t spacemesh . docker run -d --name=spacemesh spacemesh ``` ### Windows On Windows you will need the following prerequisites: - Powershell - included by in Windows by default since Windows 7 and Windows Server 2008 R2 - [Git for Windows](https://gitforwindows.org/) - after installation remove `C:\Program Files\Git\bin` from [System PATH](https://www.java.com/en/download/help/path.xml) (if present) and add `C:\Program Files\Git\cmd` to System PATH (if not already present) - [Make](http://gnuwin32.sourceforge.net/packages/make.htm) - after installation add `C:\Program Files (x86)\GnuWin32\bin` to System PATH - [Golang](https://golang.org/dl/) - GCC. There are several ways to install gcc on Windows, including Cygwin. Instead, we recommend [tdm-gcc](https://jmeubank.github.io/tdm-gcc/) which we've tested. Close and reopen powershell to load the new PATH. You can then run the command `make install` followed by `make build` as on UNIX-based systems. ### Running a Local Testnet - You can run a local Spacemesh Testnet with 6 full nodes, 6 user accounts, and 1 POET support service on your computer using docker. - The local testnet full nodes are built from this repo. - This is a great way to get a feel for the protocol and the platform and to start hacking on Spacemesh. - Follow the steps in our [Local Testnet Guide](https://testnet.spacemesh.io/#/README) ### Improved decentralization and P2P diagnostic features **WARNING! THIS IS EXPERIMENTAL FUNCTIONALITY, USE WITH CARE!** In order to make the p2p network more decentralized, the following options are provided: - `"enable-routing-discovery": true`: enables routing discovery for finding new peers, including those behind NAT, ans also for discovering relay nodes which are used for NAT hole punching. Note that hole punching can be done when both ends of the connection are behind an endpoint-independent ("cone") NAT. - `"routing-discovery-advertise": true` advertises this node for discovery by other peers, even if it is behind NAT. - `"enable-quic-transport": true`: enables QUIC transport which, together with TCP transport, heightens the changes of successful NAT hole punching. - `"enable-tcp-transport": false` disables TCP transport. This option is intended to be used for debugging purposes only! - `"static-relays": ["/dns4/relay.example.com/udp/5000/quic-v1/p2p/...", ...]` provides a static list of relay nodes for use for NAT hole punching in case of routing discovery based relay search is not to be used. - `"ping-peers": ["p2p_id_1", "p2p_id_2", ...]` runs P2P ping against the specified peers, logging the results. For the purpose of debugging P2P connectivity issues, the following command can also be used: ```console $ grpcurl -plaintext 127.0.0.1:9093 spacemesh.v1.DebugService.NetworkInfo { "id": "12D3Koo...", "listenAddresses": [ "/ip4/0.0.0.0/tcp/50212", "/ip4/0.0.0.0/udp/59458/quic-v1", "/p2p-circuit" ], "knownAddresses": [ "/ip4/127.0.0.1/tcp/50212", "/ip4/127.0.0.1/udp/59458/quic-v1", "/ip4/192.168.33.5/tcp/50212", "/ip4/192.168.33.5/udp/59458/quic-v1", "/ip4/.../tcp/37670/p2p/12D3Koo.../p2p-circuit", "/ip4/.../udp/37659/quic-v1/p2p/12D3Koo.../p2p-circuit", "/ip4/.../tcp/31960/p2p/12D3Koo.../p2p-circuit", "/ip4/.../udp/33377/quic-v1/p2p/12D3Koo.../p2p-circuit" ], "natTypeUdp": "Cone", "natTypeTcp": "Cone", "reachability": "Private" } ``` #### Next Steps - Please visit our [wiki](https://github.com/spacemeshos/go-spacemesh/wiki) - Browse project [go docs](https://godoc.org/github.com/spacemeshos/go-spacemesh) - Spacemesh Protocol [video overview](https://www.youtube.com/watch?v=jvtHFOlA1GI) ### Got Questions? - Introduce yourself and ask anything on [Discord](http://chat.spacemesh.io/). - DM [@teamspacemesh](https://twitter.com/teamspacemesh) ", Assign "at most 3 tags" to the expected json: {"id":"9777","tags":[]} "only from the tags list I provide: [{"id":77,"name":"3d"},{"id":89,"name":"agent"},{"id":17,"name":"ai"},{"id":54,"name":"algorithm"},{"id":24,"name":"api"},{"id":44,"name":"authentication"},{"id":3,"name":"aws"},{"id":27,"name":"backend"},{"id":60,"name":"benchmark"},{"id":72,"name":"best-practices"},{"id":39,"name":"bitcoin"},{"id":37,"name":"blockchain"},{"id":1,"name":"blog"},{"id":45,"name":"bundler"},{"id":58,"name":"cache"},{"id":21,"name":"chat"},{"id":49,"name":"cicd"},{"id":4,"name":"cli"},{"id":64,"name":"cloud-native"},{"id":48,"name":"cms"},{"id":61,"name":"compiler"},{"id":68,"name":"containerization"},{"id":92,"name":"crm"},{"id":34,"name":"data"},{"id":47,"name":"database"},{"id":8,"name":"declarative-gui "},{"id":9,"name":"deploy-tool"},{"id":53,"name":"desktop-app"},{"id":6,"name":"dev-exp-lib"},{"id":59,"name":"dev-tool"},{"id":13,"name":"ecommerce"},{"id":26,"name":"editor"},{"id":66,"name":"emulator"},{"id":62,"name":"filesystem"},{"id":80,"name":"finance"},{"id":15,"name":"firmware"},{"id":73,"name":"for-fun"},{"id":2,"name":"framework"},{"id":11,"name":"frontend"},{"id":22,"name":"game"},{"id":81,"name":"game-engine "},{"id":23,"name":"graphql"},{"id":84,"name":"gui"},{"id":91,"name":"http"},{"id":5,"name":"http-client"},{"id":51,"name":"iac"},{"id":30,"name":"ide"},{"id":78,"name":"iot"},{"id":40,"name":"json"},{"id":83,"name":"julian"},{"id":38,"name":"k8s"},{"id":31,"name":"language"},{"id":10,"name":"learning-resource"},{"id":33,"name":"lib"},{"id":41,"name":"linter"},{"id":28,"name":"lms"},{"id":16,"name":"logging"},{"id":76,"name":"low-code"},{"id":90,"name":"message-queue"},{"id":42,"name":"mobile-app"},{"id":18,"name":"monitoring"},{"id":36,"name":"networking"},{"id":7,"name":"node-version"},{"id":55,"name":"nosql"},{"id":57,"name":"observability"},{"id":46,"name":"orm"},{"id":52,"name":"os"},{"id":14,"name":"parser"},{"id":74,"name":"react"},{"id":82,"name":"real-time"},{"id":56,"name":"robot"},{"id":65,"name":"runtime"},{"id":32,"name":"sdk"},{"id":71,"name":"search"},{"id":63,"name":"secrets"},{"id":25,"name":"security"},{"id":85,"name":"server"},{"id":86,"name":"serverless"},{"id":70,"name":"storage"},{"id":75,"name":"system-design"},{"id":79,"name":"terminal"},{"id":29,"name":"testing"},{"id":12,"name":"ui"},{"id":50,"name":"ux"},{"id":88,"name":"video"},{"id":20,"name":"web-app"},{"id":35,"name":"web-server"},{"id":43,"name":"webassembly"},{"id":69,"name":"workflow"},{"id":87,"name":"yaml"}]" returns me the "expected json"