David's Blog

What I did when open source library changed to semi open source

By David Li on Mon, 11 July 2020 13:00:00 GMT
Image post 3

As an programmer and an inspiring investor, I have tried to automate a lot of the web scrapping, analysis and notifications for certain stocks. One of the best open-source libraries I discovered mid 2020 was mlfinlab. Around August 2020, they decided to switch over to a closed source model, luckily I had opened an issue and made a fork for a small typo.

Some of the work I have done with mlfinlab includes creating estimated returns functions to calculate profit, create portfolio strategies (buy and hold), sharpe ratio.

mlfinlab pr

For some reason mlfinlab (probably money) decided to go to a open-core model, like many other premium code offerings, this means you have to pay to get all features. In this case, this meant documentation was needed.

Do not know if I am stupid or something, but I used to think that their pateron was had 3000 subscribers and they paid $10 each, geez open-source development really will not pay the bills. Makes me wonder how hard it is to support themselves (this is why I have ads on my site :)). From the looks of things they are only making 3000 dollars in total.

wayback machine

Now if I made a library with 10k stars and only had $3000 dollars revenue and the pandemic hit while many investors are profitable, I would also consider using a paywall, but come on, you guys are possibly making money already. I think the reason they are asking for payment is so that you are more likely to use their services.

I already had a forked version of the main mlfinlab repo with all the proper docs, as a contributor I think I had the write to compile the documentation and “privately” host it (will not openly share this, although you could probably find it).

The only problem is the examples linked in the documentation (were very helpful for new investors like me) were stuck under a paywall.

So my approach to solve this problem was to use the good old internet wayback machine. My first instinct was to check the public forks as they are not deleted, but wayback machine didnt record that page. Then I checked through the pull requests, but only interns with hudson and thames were making prs.

wayback machine

Ultimately I found that stargazers (maybe people look at this) were tracked so I started checking all the stargazers to make sure they have repos of the old public research repo. I found a version that was a little outdated used the website to find the most active forks and merged that code into mine.

Link Tracker

Then, I made sure I forked all the code and kept it on my public github.

Ulimately, in this era where there are excellent open source code libraries available for free, do not trust that any company will always keep their source code public.

Update Someone forked my mlfinlab repo, I must have done the latest change :).

© Copyright 2024 by FriendlyUsers Tech Blog. Built with ♥ by FriendlyUser. Last updated on 2024-04-18.