GREAT NEWS!!! We have a SEARCH ENGINE!!!

This is a follow-up of a post earlier this month:

https://discussion.fool.com/thank-you-for-posting-this-fricknfoo…

To recap: there’s a non-TMF affiliated search engine for 10 various boards:

http://www.datahelper.com/mi/search.phtml

And of course, every regular reader of this board, upon finding out about this, had the IMMEDIATE thought:

OMG, it would be INCREDIBLY useful if Saul’s board were to be added to this list! How can we make this happen??

The answer to that question is is simple: https://www.youtube.com/watch?v=iNoAHetRpEA

Apparently, this search engine goes way back to not long after the dot-com crash. When it wasn’t clear how many tech companies would survive. What if The Motley Fool, and all of its discussion boards, were to disappear without warning? (Yes, that’s actually what inspired its creation. And if you’re familiar with the state-of-the-art TMF boards, that’s actually not a ridiculous fear.) Thus was born the aforementioned search engine!

How do I know this? Because I emailed the host of that website. His username on here is MarkW, though I will henceforth refer to him as our Hero Of The Month (H.O.T.M.). Sorry, Eric Yuan. (https://discussion.fool.com/zoom-ceo-eric-yuan-hero-34519852.asp…)

Our Hero hasn’t been too active on here lately, and he wasn’t familiar with Saul’s board. So after a quick elevator pitch and a sheepish request to add Saul’s board to his search engine, pro bono (you would cringe too, writing the owner of an independent software company for a software-related favor, because, um…there’s this old guy on the internet who can really get 75% CAGR, year-over-year, no strings attached. Seriously! Yeah, that sounds legit), I was relieved to find an enthusiastic email in my inbox the following morning.

Anyways, it wasn’t as simple as changing a single line of code, but our H.O.T.M. was happy to do it. But it would take some time to download all of the messages from TMF website without upsetting the web overloads (don’t laugh, have you been on TMF message boards? Have you also seen The Rest Of The Internet?) Saul’s board started in early 2014, and our H.O.T.M. started scraping the board posts, pseudo-manually, from oldest to newest. This was a week ago. I’ve been checking every day for the past week, and now we’re up to early 2019. If all goes well, sometime this week, we should be up-to-date.

Take a look! It’s not perfect, it doesn’t have every bell and whistle that one could dream up. But it gets the job done. And it’s AWESOME. You can search by keyword, by author, you can specify a date range, and pull up to 500 messages at once. Thank you, H.O.T.M.

What does this mean? First, bookmark this page immediately. Going forward (referencing a post from earlier today), when someone like Miklo wonders about VEEV (or I ask about 2014 darling AEYE), and Googing “site:fool.com Saul VEEV” brings up 2-3 unhelpful results, now they can search every message ever posted to Saul’s board containing “VEEV”. Hopefully this will reduce board clutter, and hopefully it will encourage people to cite old “deep dives” on companies they’re discussing, for quick reference, because Google isn’t really all that helpful. We all know this.

One last thing. For everyone in my shoes, who awkwardly answered the question “what do you want for Father’s Day?”, with “uhhhh, I dunno, whatever”: THIS IS YOUR FATHER’S DAY GIFT!!! ENJOY!!!

137 Likes

haha great timing :slight_smile:

I had some time over the weekend and spun up https://easystocknumbers.com/search.html which hopefully does a similar thing. Highly experimental however, and the elasticsearch engine is running on the smallest AWS box I could find which means it’s liable to fall over :slight_smile:

It updates every 2 minutes at the moment and has pretty bare bones search options. Very easy to extend however.

let me know if any suggestions (via email), I’ll leave it up for a bit but if people prefer the previous one, I’ll kill it off.

cheers
Greg

35 Likes

This would be a great candidate for a link on the right-hand side of the page. :wink:

Thanks, Matt, for working behind the scenes to make this happen.

4 Likes

haha great timing :slight_smile: I had some time over the weekend and spun up https://easystocknumbers.com/search.html which hopefully does a similar thing. Highly experimental however, and the elasticsearch engine is running on the smallest AWS box I could find which means it’s liable to fall over :slight_smile: It updates every 2 minutes at the moment and has pretty bare bones search options. Very easy to extend however.

let me know if any suggestions (via email), I’ll leave it up for a bit but if people prefer the previous one, I’ll kill it off.
cheers
Greg

Greg,
It’s wonderfully simple and easy to use. I tried it and it just works. Please leave it up unless that’s a problem for you.
Thanks,
Saul

20 Likes

Can we put a link to the tool underneath the knowledge base or somewhere on the side of the page?

Gordon

4 Likes

Greg,
It’s wonderfully simple and easy to use. I tried it and it just works. Please leave it up unless that’s a problem for you.
Thanks,
Saul

But you’d have to add more sophisticated choices so one could ask for Author AND Subject AND most recommendations (and maybe AND most recent), and maybe posts with two subjects. It probably gets to be too much work for you to put together…
Saul

1 Like

Can we put a link to the tool underneath the knowledge base or somewhere on the side of the page?

I’ll ask FrickNFool who keeps that up for us.
Saul

8 Likes

Greg, Incredibly fast…nice job!

Matt, terrific that you got him to do that!

1 Like

Hi All,

Are people also using the http://www.datahelper.com/mi/search.phtml link? As Matt said, it looks like it does not have all messages up to 2020 indexed yet but does to 2019.
Best,
Travis

Hi Saul, thanks for that. I tried to keep it as simple as possible for the first cut, so people could play with it and then make suggestions for what it was really missing, rather than building the kitchen sink!

It’s pretty straightforward to add options (yay ElasticSearch), and probably adding some sorting options (recs, date) for the searches would solve most of the issues.

But let me know, I’ll add things as I get time and they occur. I also want to add a “Save this post” feature, so I can keep a collection of my favourite posts.

cheers
Greg

7 Likes

That works very well. Thanks for sharing and this post or link should be added in the knowledge base or right of the page.

Greg, That’s a pretty useful tool. Someone mentioned it would be more useful if you incorporated some Boolean operators, I agree but I don’t know how much of a pain that might be. One other thing I noticed, I searched for author “saul” and got zero returns. However, “Saul” returned several hits. It appears to be semi case sensitive. I think there are very few cases where we would actually desire case sensitivity.

DONATE! He’s been running that service (datahelper) pro bono for almost 20 years. It is a gift, but it’s not without cost!

4 Likes