And.... here we go! The main Mastodon Network Monitoring dashboard now features a #realtime #worldmap of #mastodon users!
--
Et voila ! le dashboard principal de Mastodon Network Monitoring inclut maintenant une carte du monde en temps réel des utilisateurs de Mastodon !
Live version -> https://mnm.eliotberriot.com
@eliotberriot well done! Waiting that the hashtag monitor is out of test mode...
@vilbi it's not totally stable at the moment (the worker stopped this afternoon and no data was collected for a few hours), but nothing unsolvable.
The next goal will be to find a way to aggregate toots from other instances, because using only mastodon.xyz is not really representative of the whole fediverse.
But anyway, I'm quite happy with the result!
@vilbi at the moment, I'm subscribing to mastodon.xyz streaming API.
This API sends me toots of the instance public timeline in real-time. Since the public timeline includes also toots from other instances (because some mastodon.xyz users follow users form other instances), I get toots from various instances in real-time.
I then extract data from these toots (language, country, hashtags, medias...) and store it in a convenient format for dashboard use.
1/
@eliotberriot I was thinking about how to grap the max no. of the federation
@vilbi to make the whole think more comprehensive, I'd have to subscribe to other "big" instances, such as mastodon.social, unfortunately, the streaming API of each instance is only reachable by authenticated users, and I cannot create an account on every big instance.
Also, I'll probably face some scaling problem, since I'm currently processing ~10 statuses per minute, but hundreds of toots are published every minute on the fediverse, and this number will grow.
2/
@vilbi to make the whole think more comprehensive, I'd have to subscribe to other "big" instances, such as mastodon.social, unfortunately, the streaming API of each instance is only reachable by authenticated users, and I cannot create an account on every big instance.
Also, I'll probably face some scaling problem, since I'm currently processing ~10 statuses per minute, but hundreds of toots are published every minute on the fediverse, and this number will grow.
2/
@eliotberriot maybe it's the wrong approach to scan as many toots as possible, because it may include a risk of 'big brother' data collection... what about change from one instance pulling all to all instances pushing/presenting an anonymus hashtag collection....
@eliotberriot true, it is a good preview for the potential! It is interesting that you seem to scan most of the federation, instance by instance, for the use of hashtags... or do you have a different approach?