Insights from an open source influencer

I'm often asked how I get my content, over the years I've built an unusual technology stack for it

https://t.co/FdIAeZc8GF

Some insights:

I use Feedly for most content inputs because I can access the content through a single API endpoint and scraping is often pure pain.

@feedly

Feedly saves me a lot of time and manual work.

https://t.co/CeHju43rwJ
To pull and enrich my GitHub content I use ghapi from @fastdotai which provides a 100% always-updated coverage of the entire GitHub API

https://t.co/c0HwjoShvg
The actual magic happens on my server infrastructure.

This is where the various data streams converge and are enriched.

The whole thing is based on Kafka streams so that if a pipeline stops it can be started up again without any problems.
Then a wild mix of machine learning NLP pipelines between @huggingface and @spacy_io is used to classify, score and tag the content.
For analysis I have a @neo4j instance to analyze my network relations and the engagement.

This is also used to find potential new sources.

Why?

Because it's about engagement, influence and adding value
Spread the open source love!

If you know an amazing project drop me a message
@philipvollet

https://t.co/FdIAeZc8GF

More from All

You May Also Like

Fake chats claiming to be from the Irish African community are being disseminated by the far right in order to suggest that violence is imminent from #BLM supporters. This is straight out of the QAnon and Proud Boys playbook. Spread the word. Protest safely. #georgenkencho


There is co-ordination across the far right in Ireland now to stir both left and right in the hopes of creating a race war. Think critically! Fascists see the tragic killing of #georgenkencho, the grief of his community and pending investigation as a flashpoint for action.


Across Telegram, Twitter and Facebook disinformation is being peddled on the back of these tragic events. From false photographs to the tactics ofwhite supremacy, the far right is clumsily trying to drive hate against minority groups and figureheads.


Declan Ganley’s Burkean group and the incel wing of National Party (Gearóid Murphy, Mick O’Keeffe & Co.) as well as all the usuals are concerted in their efforts to demonstrate their white supremacist cred. The quiet parts are today being said out loud.


The best thing you can do is challenge disinformation and report posts where engagement isn’t appropriate. Many of these are blatantly racist posts designed to drive recruitment to NP and other Nationalist groups. By all means protest but stay safe.