Breast Expansion Archive Forum

The Arts => The Plume => Topic started by: Freeforall on October 26, 2017, 12:41:03 AM

Title: Search
Post by: Freeforall on October 26, 2017, 12:41:03 AM
Until a while ago, I was able to search for particular things in the addventure through refined google searches, but it all comes out blank now, what changed?
Title: Re: Search
Post by: Adama on October 26, 2017, 12:17:55 PM
Because a login is now required to access the Addventure, Google can no longer index the pages.  Hopefully the BEA will be persuaded to change that.
Title: Re: Search
Post by: EFHR on November 12, 2017, 09:31:50 AM
On a semi-related note, maybe it's just me but for the last year or two, I haven't been able to search Bimbo via refined Google Searches.

I think someone nuked that, so even if the Log-In issue did get reverted, kind of a pain in the ass to search stuff with only the tags.
Title: Re: Search
Post by: JH_ on November 13, 2017, 04:20:54 AM
That seems very odd. I can imagine various obscene or sexual words that Google might decide to ban from being used as search terms, but it's hard to believe that "bimbo" would be one of them.
Title: Re: Search
Post by: Nameless Soul on November 13, 2017, 03:38:08 PM
On a semi-related note, maybe it's just me but for the last year or two, I haven't been able to search Bimbo via refined Google Searches.

I've noticed this too. Also, for me at least Google searches still kinda works if I'm logged in in another tab (even in incognito mode).
Title: Re: Search
Post by: JH_ on December 03, 2017, 05:07:24 AM
The good news is that, now that a login is no longer required, using Google to search the addventure works again. Out of curiosity, I tried searching for "bimbo" and no matches were found. I then thought that I'd get clever and search for "bimb", but that didn't work either.
Title: Re: Search
Post by: JH_ on December 03, 2017, 01:28:08 PM
What makes it even stranger is that if you just put the single word "bimbo" into Google, i.e. don't restrict it to searching the addventure, you get plenty of hits.
Title: Re: Search
Post by: Benji Dude on December 05, 2017, 03:19:24 AM
The good news is that, now that a login is no longer required, using Google to search the addventure works again. Out of curiosity, I tried searching for "bimbo" and no matches were found. I then thought that I'd get clever and search for "bimb", but that didn't work either.

I would imagine it'll take a while for the Google bots to re-find the addventure and catalogue it all, give it a few days and try again.
Title: Re: Search
Post by: JH_ on December 06, 2017, 02:24:21 AM
But prior to searching for "bimbo" I'd done another search (I can't remember for what" and got plenty of hits.
Title: Re: Search
Post by: HC on December 16, 2017, 02:40:23 PM
Just tried to look for the Secret Bimbo Outbreak on the new Google Search our of curiosity. Didn't work. Bimbofication also doesn't work.

Curiously, when you just write Secret Outbreak it shows the threads just fine. Is Bimbo a banned word for google or the BE addventure or something?
Title: Re: Search
Post by: Adama on December 16, 2017, 10:24:57 PM
A very good question...

Interestingly I could search for "bimbo" on another site, and it found ONE result -- but I wonder if it found that one because the word was capitalized on that page?
Title: Re: Search
Post by: JH_ on December 17, 2017, 10:57:41 AM
It's very mysterious. Just searching for "bimbo" non-site specifically turns up plenty of hits - amazingly, there appears to be a "Bimbo Bakeries USA" - so it doesn't seem to be Google's doing. And "bimbo" isn't one of the censored words on the BEArchive, so it's hard to see why (or even how, for that matter) the site would prevent searches for it.
Title: Re: Search
Post by: catfishplus on December 17, 2017, 10:55:24 PM
...amazingly, there appears to be a "Bimbo Bakeries USA"...

They're a big Mexican company that has bought up a bunch of American food brands -- Thomas's English Muffins, Sara Lee, Ball Park hot dogs. I've seen no evidence that eating their products causes bimboization, but you never know.

Anyway, I note that Bing has exactly the same "bimbo" search issues that Google does. Very bizarre.
Title: Re: Search
Post by: HC on February 13, 2018, 11:40:19 AM
Just in case anyone is curious, it still does not show anything if you look the BE addventure with the term Bimbo... very strange.. anyone have new information on why this is a thing?
Title: Re: Search
Post by: JH_ on February 13, 2018, 04:01:22 PM
I tried searching on "bim", but though there were seven hits none of those episodes contained "bimbo". (Though apparently "bim-boy" is OK.)
Title: Re: Search
Post by: Freeforall on February 16, 2018, 11:09:48 AM
Anyway, I've managed to cobble up a solution. I can help with searches if anyone is having trouble finding a particular episode through words or names they might remember.
Title: Re: Search
Post by: JH_ on February 17, 2018, 12:12:08 PM
Anyway, I've managed to cobble up a solution. I can help with searches if anyone is having trouble finding a particular episode through words or names they might remember.

When you say a solution, do you mean to the mysterious "bimbo" issue? Apart from that, I wasn't aware of there being a problem with searching any more, and Adama has recently added a search facility to the Recent Episodes page to make it even easier.
Title: Re: Search
Post by: Freeforall on February 17, 2018, 04:44:02 PM
Anyway, I've managed to cobble up a solution. I can help with searches if anyone is having trouble finding a particular episode through words or names they might remember.

When you say a solution, do you mean to the mysterious "bimbo" issue? Apart from that, I wasn't aware of there being a problem with searching any more, and Adama has recently added a search facility to the Recent Episodes page to make it even easier.

I made a local mirror of the addventure tree and indexed the HTML files. I can do text based searches now. (Kinda like google, but with all episodes considered)
Title: Re: Search
Post by: Benji Dude on February 21, 2018, 03:59:52 PM
Yeah I still get nothing when searching the term "bimbo".  I'm not nearly technical enough to start deciphering why Google does it but it is annoying.
Title: Re: Search
Post by: Freeforall on February 21, 2018, 10:39:54 PM
Yeah I still get nothing when searching the term "bimbo".  I'm not nearly technical enough to start deciphering why Google does it but it is annoying.
(https://i.imgur.com/UlaNBWB.jpg)

7000+ episodes with bimbo on it.
i would have guessed more really.
Title: Re: Search
Post by: JH_ on February 22, 2018, 10:13:09 AM
Nice.  :) So you've mirrored the whole addventure? on your own machine? That's might impressive. How long did downloading that lot take?
Title: Re: Search
Post by: Adama on February 22, 2018, 08:04:59 PM
Nice job.  I'd like to know more about it too.

I've thought about doing my own search-engine implementation for the Addventure, but a) the Addventure server doesn't have the capacity to support it and I don't have a server of my own, and b) Google isn't so bad, assuming that it ever finishes indexing the episodes on the new site.
Title: Re: Search
Post by: Freeforall on February 23, 2018, 01:41:15 PM
it took about a week, but I intentionally didn't go for an intensive method in order to avoid any possible issues with the server.
it wasn't anything sophisticated, just generating the million plus possible episode addresses into a text file and feeding them to a downloader.
now i'm getting rid of the "create new episode" files to improve performance in the search program.

I tried using a crawler first, but I couldn't get it to work right on the site, probably the same reason google hasn't re-indexed the new site fully either.
Title: Re: Search
Post by: Freeforall on June 13, 2020, 11:36:22 AM
Well, I just updated my backup, and I noticed it all fits on a less than 500 mb rar. Adama, should I upload it somewhere so people who want it can have their own? I understand if it's not advisable. 
Title: Re: Search
Post by: JH_ on June 13, 2020, 03:47:37 PM
Assuming Adama has no objections to your doing that, I'd certainly be interested in downloading it.
Title: Re: Search
Post by: Adama on June 13, 2020, 10:12:27 PM
You're free to do so...

FYI: about a month ago I finally set up a backup server on Amazon, and there's now an incremental backup of the whole Addventure done each night.  I also wrote a script to run on that machine to extract just the episode files by themselves and put them in a ZIP file.  (In other words, the ZIP file does NOT contain any of the comments or unused episodes).  The ZIP file isn't publicly available, but I could send an updated one to someone if requested.