A few days ago, I converted my original script, which is written in Python and only ran locally on my computer, into an application that can run in a browser with an interface. You can find the article here: @louis88/a-single-file-analytics-tool-to-find-post-payouts-from-a-list-of-users
I was actually very happy with the development, as everything worked as I had imagined. But for a long time I had been thinking that retrieving information for every single API call per account is simply too resource-intensive and takes far too long. The idea that came to me was to rewrite the software in such a way that it can be realized with the HiveSQL database query, since information can be retrieved directly and almost instantly. Since I am not very familiar with SQL, I simply discarded this idea and continued working with the API endpoint version. After I published the API version on Github the day before yesterday, I took it upon myself to spend the day yesterday getting to grips with SQL a little more. I became aware of the new development by @blocktrades and
@mahdiyari, who have published HAFSQL. More about this in the articles
https://gitlab.com/mahdiyari/hafsql
https://gitlab.com/mahdiyari/hafsql-api
@mahdiyari/hafsql-update-200-rc1-breaking-changes
@mahdiyari/public-hafsql-database-on-haf
Proposal: @mahdiyari/proposal-public-haf-hafsql-database-maintenance-and-development-of-hafsql
My goal was not to retrieve lists of 18,000 for several hours via the API calls, for example, but to get to the details quickly, because waiting several hours was simply lousy and I no longer wanted to. So yesterday I took the time to rebuild the software based on calls to the HAFSQL database from mahdiyari. I have to say, this variant is simply lightning fast and delivers exactly the result I expected. However, I still had another problem - I can't make SQL queries from a local HTML document, for example, so I have to outsource the software to a web server using NodeJS, for example, so that the queries work. Locally this wasn't a problem, but so that you can view and use the software, I had to switch to a service called Render.com, which provides me with a mini-server and receives a ping from uptimerobot every 5 minutes so that the server is (hopefully) permanently online. Anyway, I'm happy that after many hours of work it worked and services like Hivewatchers but also every single user of yours can work with it. Here is the software with the HAFSQL integration:
A web-based dashboard for monitoring Hive blockchain posts using HafSQL database. This tool allows you to track posts from multiple accounts, monitor their payouts, and analyze engagement metrics.
https://hive-fetcher-hafsql.onrender.com/
(Running on Render.com / If Service is unavailable - please drop me a Message.)
Github Repo: https://github.com/louis-88/hive-fetcher-hafsql
git clone https://github.com/louis-88/hive-fetcher-hafsql.git
cd hive-hafsql-fetcher
npm install
node server.js
http://localhost:3000
Enter Hive usernames (one per line) or upload a text file containing usernames
Configure settings:
Click "Start Monitoring" to begin processing
The dashboard comes preconfigured to connect to the public HafSQL instance:
Host: hafsql.mahdiyari.info
Port: 5432
Database: haf_block_log
Username: hafsql_public
Password: hafsql_public
You can change these settings through the "Custom HAFSQL Credentials" section in the dashboard.
GET /: Serves the main dashboardPOST /update-credentials: Updates HafSQL connection settingsPOST /query: Fetches post data for specified accountsMIT
That's it for now - if you have any questions or suggestions, please write a message in the comments.