Zcashd help

I have a zcashd -daemon that quits. Running on Debian 11 using the 5.2.0 from apt. I have rpcuser, rpcpassword and server=1 in the zcash.conf.

I may have run out of disk space causing it to fall 2 days behind. Or it may have quit on its own accord. I have 2 vCPU cores and 8 GB of RAM. The machine has been running fine for months with RPC jobs against it. I added disk space, and CPU cores and memory. So, 150GB of storage with about 50GB free, 4 vCPU and 16GB of RAM. None of this appears to be a problem at this point.

When I try to run zcashd -daemon, it logs the following and then dies a few minutes later:

2022-08-30T02:37:15.543736Z  INFO main: Zcash version v5.2.0 (2022-07-26 09:03:35 -0600)
2022-08-30T02:37:15.545682Z  INFO Init: main: InitParameterInteraction: parameter interaction: -whitelistforcerelay=1 -> setting -whitelistrelay=1
2022-08-30T02:37:15.555061Z  INFO Init: main: Using the 'sse4(1way),sse41(4way),avx2(8way)' SHA256 implementation
2022-08-30T02:37:15.569933Z  INFO Init: main: Using BerkeleyDB version Berkeley DB 6.2.23: (March 28, 2016)
2022-08-30T02:37:15.571668Z  INFO Init: main: Default data directory /home/skyl/.zcash
2022-08-30T02:37:15.571690Z  INFO Init: main: Using data directory /home/skyl/.zcash
2022-08-30T02:37:15.571714Z  INFO Init: main: Using config file /home/skyl/.zcash/zcash.conf
2022-08-30T02:37:15.571727Z  INFO Init: main: Using at most 125 connections (1024 file descriptors available)
2022-08-30T02:37:15.580118Z  INFO Init: main: Using 16 MiB out of 16 requested for signature cache, able to store 524288 elements
2022-08-30T02:37:15.584690Z  INFO Init: main: Using 8 MiB out of 8 requested for Sapling bundle cache, able to store 262144 elements
2022-08-30T02:37:15.589272Z  INFO Init: main: Using 8 MiB out of 8 requested for Orchard bundle cache, able to store 262144 elements
2022-08-30T02:37:15.589309Z  INFO Init: main: Using 2 threads for script verification
2022-08-30T02:37:15.590243Z  INFO main: scheduler thread start
2022-08-30T02:37:15.591062Z  INFO Init: main: Loading Sapling (Spend) parameters from /home/skyl/.zcash-params/sapling-spend.params
2022-08-30T02:37:15.591606Z  INFO Init: main: Loading Sapling (Output) parameters from /home/skyl/.zcash-params/sapling-output.params
2022-08-30T02:37:15.591622Z  INFO Init: main: Loading Sapling (Sprout Groth16) parameters from /home/skyl/.zcash-params/sprout-groth16.params
2022-08-30T02:37:20.911293Z  INFO Init: main: Loading Orchard parameters
2022-08-30T02:37:27.769865Z  INFO Init: main: Loaded proof system parameters in 12.178207s seconds.
2022-08-30T02:37:27.773410Z  INFO Init: main: HTTP: creating work queue of depth 16
2022-08-30T02:37:27.773562Z  INFO Init: main: Config options rpcuser and rpcpassword will soon be deprecated. Locally-run instances may remove rpcuser to use cookie-based auth, or may be replaced with rpcauth. Please see share/rpcuser for rpcauth auth generation.
2022-08-30T02:37:27.773592Z  INFO Init: main: HTTP: starting 4 worker threads
2022-08-30T02:37:27.775548Z  INFO Init: main: Using wallet wallet.dat
2022-08-30T02:37:27.775589Z  INFO Init: main: init message: Verifying wallet...
2022-08-30T02:37:27.775643Z  INFO Init: main: CDBEnv::Open: LogDir=/home/skyl/.zcash/database ErrorFile=/home/skyl/.zcash/db.log
2022-08-30T02:37:28.484436Z  INFO Init: main: Bound to [::]:8233
2022-08-30T02:37:28.484809Z  INFO Init: main: Bound to 0.0.0.0:8233
2022-08-30T02:37:28.484869Z  INFO Init: main: Cache configuration:
2022-08-30T02:37:28.484885Z  INFO Init: main: * Using 2.0MiB for block index database
2022-08-30T02:37:28.484894Z  INFO Init: main: * Using 120.0MiB for chain state database
2022-08-30T02:37:28.484903Z  INFO Init: main: * Using 328.0MiB for in-memory UTXO set
2022-08-30T02:37:28.484911Z  INFO Init: main: init message: Loading block index...
2022-08-30T02:37:28.493264Z  INFO Init: main: Opening LevelDB in /home/skyl/.zcash/blocks/index
2022-08-30T02:37:28.522970Z  INFO Init: main: Opened LevelDB successfully
2022-08-30T02:37:28.523443Z  INFO Init: main: Opening LevelDB in /home/skyl/.zcash/chainstate
2022-08-30T02:37:28.543506Z  INFO Init: main: Opened LevelDB successfully
2022-08-30T02:38:13.158134Z  INFO Init: main: LoadBlockIndexDB: last block file = 648
2022-08-30T02:38:13.160450Z  INFO Init: main: LoadBlockIndexDB: last block file info: CBlockFileInfo(blocks=15, size=20536105, heights=1787166...1787256, time=2022-08-27...2022-08-27)
2022-08-30T02:38:13.160488Z  INFO Init: main: Checking all blk files are present...
2022-08-30T02:38:13.688081Z  INFO Init: main: LoadBlockIndexDB: transaction index disabled
2022-08-30T02:38:13.688131Z  INFO Init: main: LoadBlockIndexDB: insight explorer disabled
2022-08-30T02:38:13.688138Z  INFO Init: main: LoadBlockIndexDB: light wallet daemon disabled
2022-08-30T02:38:15.037835Z  INFO Init: main: LoadBlockIndexDB: hashBestChain=0000000000bf700bd82dbffc0f08e137bc216970a9a4cc5dff544522ca083d0e height=1787103 date=2022-08-27 00:00:12 progress=0.997957
2022-08-30T02:38:15.057341Z  INFO Init: main: init message: Rewinding blocks if needed...
2022-08-30T02:38:21.788976Z  INFO Init: main: init message: Verifying blocks...
2022-08-30T02:38:21.789066Z  INFO Init: main: Verifying last 288 blocks at level 3
2022-08-30T02:39:05.935403Z  INFO Init: main: No coin database inconsistencies in last 73 blocks (415 transactions)
2022-08-30T02:39:06.011595Z  INFO Init: main:  block index           97527ms
2022-08-30T02:39:06.013328Z  INFO Init: main: init message: Loading wallet...
2022-08-30T02:39:06.379438Z  INFO Init: main: nFileVersion = 5020050
2022-08-30T02:39:06.379481Z  INFO Init: main: Keys: 103 plaintext, 0 encrypted, 103 w/ metadata, 103 total
2022-08-30T02:39:06.379489Z  INFO Init: main: ZKeys: 3 plaintext, 0 encrypted, 3 w/metadata, 3 total
2022-08-30T02:39:06.380975Z  INFO Init: main:  wallet                  367ms
2022-08-30T02:39:06.381346Z  INFO Init: main: init message: Rescanning...
2022-08-30T02:39:06.381374Z  INFO Init: main: CWallet::InitLoadWallet(): Rescanning last 4 blocks (from block 1787099)...
2022-08-30T02:39:06.381387Z  INFO Init: main: CWallet::ScanForWalletTransactions(): Rewinding Orchard wallet to height 1787098; current is 1787099

2022-08-30T02:40:24.699402Z  INFO Init: main: Still rescanning. At block 1787102. Progress=0.997955

Only seems to be using 1 vCPU core 100% and about 5GB of memory. Should I set the logging differently to see more? Are there any configurations I should try? Should I rewind or rescan or start zcashd with some special arguments?

Running in the foreground without -daemon results in Segmentation fault.

Here’s my experience with zcashd v5.2.0:

  • Node A: Stopped zcashd, updated via apt, restarted and worked right away.
  • Node B: Stopped zcashd, updated via apt, restarted and got segmentation faults. Decided to copy the settings from node A to node B, specifically experimentalfeatures=1, txindex=1 and insight-explorer=1. With this, I started a reindex and everything went well until the node got to the “sandblasting” blocks. Here, zcashd would periodically go from a steady ~5GB of RAM consumed to a steady increase that would eventually hit the limit and the system would shutdown zcashd with an out-of-memory error. After days of restarting the node, it eventually caught up and it has been running fine since.

Hope this helps.

4 Likes