Skip to main content

Mar 25, 2022 Updates

· 2 min read
Bohdan Khorolets
Olga Telezhnaya
Vlad Frolov

👋 Hello everyone! It's been a while since the last update. Things went bananas in the world. Data Platform Team is currently safe and continues working. We're pushing the MVP release of NEAR Lake project and working on the refactoring of NEAR Indexer for Explorer. We're changing the data storage for Indexer for Explorer from PostgreSQL to SingleStore, it should improve the stability of the data flow and it should end up improving the stability of NEAR Explorer. At least in terms of data availability and decreasing the possible interruptions.

Since the previous update:

  • We continue backfilling the data for NEAR Lake to AWS S3. You can see the updates in this issue. For the record, we fill in some historical data for mainnet and testnet. All the fresh data is already available. (@khorolets)
  • Small yet important improvement on the near-lake-framework has been delivered. This will ensure the user gets consistent data without any gaps. (@khorolets)
  • Also, today we have added some useful debug logging to NEAR Lake Framework (@khorolets)
  • We have done some cost estimation to find out how much money a user will need to run a single instance of an indexer on top of NEAR Lake Framework. The numbers are quite exciting. Approximately $18.15 per month. See the README section and explanation by yourself. @(khorolets)
  • Ah, and we have launched a small project near-lake-pulse just to check if we have all the data stored on S3 consistently. The project is providing an endpoint with metrics for Prometheus. The source code might be used for inspiration (@khorolets)
  • We are moving forward to the public announcement of NEAR Lake, probably next week. We're going to invite early adopters. Stay tuned!
  • We have added a new table at near-analytics, it gives the understanding of average gas burnt between transactions (@telezhnaya)
  • Meanwhile we are writing/rewriting NEAR Indexer for Explorer to NEAR Lake and SingleStore as a storage here (@telezhnaya)

It's been a tough month for everyone. Anyway, we are back online and keep rocking 🤘. Stay tuned! See you around!