Forum Search limitations

feedback, comments and suggestions pertaining to the *. forums
JonC
Posts: 625
Joined: Wed May 14, 2014 9:19 pm
Location: Wakefield

Forum Search limitations

Postby JonC » Mon Jun 06, 2016 2:44 pm

Hi,

Just thought I'd drop in a suggestion to change the minimum word length on Search from 4 characters to 3, there are a lot of acronyms with 3 characters!
PLD, ULA, etc!

Cheers

Jon
Jon
Image

paulb
Posts: 784
Joined: Mon Jan 20, 2014 9:02 pm

Re: Forum Search limitations

Postby paulb » Mon Jun 06, 2016 3:11 pm

I second this motion!

User avatar
danielj
Posts: 5365
Joined: Thu Oct 02, 2008 4:51 pm
Location: Manchester

Re: Forum Search limitations

Postby danielj » Mon Jun 06, 2016 3:27 pm

The site search isn't great anyway, I'd recommend a google search sticking

Code: Select all

site:stardot.org.uk/forums/

at the beginning... There is a reason for limiting the forum search to words of 4 letters or more. I think it's because the index would suddenly become stupidly big going to three letters and you'd get spurious results left-right-and-centre... I'll check though.

d.

User avatar
paulv
Posts: 3606
Joined: Tue Jan 25, 2011 6:37 pm
Location: Leicestershire
Contact:

Re: Forum Search limitations

Postby paulv » Mon Jun 06, 2016 5:21 pm

Is there a way to "whitelist" certain three letter acronyms? Certainly most search engines have "stop words" like "the", "and" etc. but being able to specify words included in an index is also usually doable. If it's achieved in a config file, all the better. Sadly I don't know phpBB enough to say whether this is possible or not in out case :(

Paul

JonC
Posts: 625
Joined: Wed May 14, 2014 9:19 pm
Location: Wakefield

Re: Forum Search limitations

Postby JonC » Mon Jun 06, 2016 5:30 pm

If this does increase the DB load, you may be able to reduce the impact by limiting searches to logged in users only? Just an idea.
Jon
Image

User avatar
paulv
Posts: 3606
Joined: Tue Jan 25, 2011 6:37 pm
Location: Leicestershire
Contact:

Re: Forum Search limitations

Postby paulv » Mon Jun 06, 2016 5:57 pm

JonC wrote:If this does increase the DB load, you may be able to reduce the impact by limiting searches to logged in users only? Just an idea.


It would only increase load if all three letter words were allowed. If specific TLA's were whitelisted, I believe that the extra load would be negligible.

Paul

User avatar
danielj
Posts: 5365
Joined: Thu Oct 02, 2008 4:51 pm
Location: Manchester

Re: Forum Search limitations

Postby danielj » Mon Jun 06, 2016 6:02 pm

Give that a go - I switched to the PHPBB search backend which indexes words between 3 and 14 characters. We were previously using the MySQL backend which is rather more convoluted to change...

I still think using google works better though :D

d.

JonC
Posts: 625
Joined: Wed May 14, 2014 9:19 pm
Location: Wakefield

Re: Forum Search limitations

Postby JonC » Mon Jun 06, 2016 6:27 pm

Hurrah! It works. =D> \:D/ \:D/
Jon
Image

User avatar
MartinB
Posts: 4556
Joined: Mon Mar 31, 2008 9:04 pm
Location: Obscurity

Re: Forum Search limitations

Postby MartinB » Mon Jun 06, 2016 7:01 pm

Jon wrote:Hurrah! It works. =D> \:D/ \:D/


Well, perhaps some caution.... :-k

My first reaction was Yay!, I can finally search for such things as EUP and indeed I now can \:D/ :D

But...

When I do, the search picks up 492 occurrences of "EUP" across 17 pages but the newest listed is in a post dated April 2015 when there are actually waaay more recent ones :(. There are more in 2016 for example than you can shake a crooked stick at :lol:

Have I hit a limit or something? 492 seems an unusual number though? :?

User avatar
1024MAK
Posts: 6798
Joined: Mon Apr 18, 2011 4:46 pm
Location: Looking forward to summer in Somerset, UK...

Re: Forum Search limitations

Postby 1024MAK » Mon Jun 06, 2016 7:04 pm

So how come I'm getting a result for the sixth day of June in the year 2016 :lol:
For a "Complete BBC Games Archive" visit www.bbcmicro.co.uk NOW!
BeebWiki‬ - for answers to many questions...

User avatar
1024MAK
Posts: 6798
Joined: Mon Apr 18, 2011 4:46 pm
Location: Looking forward to summer in Somerset, UK...

Re: Forum Search limitations

Postby 1024MAK » Mon Jun 06, 2016 7:05 pm

Could it just be that the indexing is not yet complete?

Mark
For a "Complete BBC Games Archive" visit www.bbcmicro.co.uk NOW!
BeebWiki‬ - for answers to many questions...

JonC
Posts: 625
Joined: Wed May 14, 2014 9:19 pm
Location: Wakefield

Re: Forum Search limitations

Postby JonC » Mon Jun 06, 2016 7:10 pm

Could be, a search of MMC should have brought back Simons post from viewtopic.php?f=3&p=139787#p139787

However I got one from 2015. :D
Jon
Image

User avatar
MartinB
Posts: 4556
Joined: Mon Mar 31, 2008 9:04 pm
Location: Obscurity

Re: Forum Search limitations

Postby MartinB » Mon Jun 06, 2016 7:18 pm

I think it's clearly a content limiting conspiracy by the newly appointed orange, green and pink hierarchy.... =; [-(

User avatar
danielj
Posts: 5365
Joined: Thu Oct 02, 2008 4:51 pm
Location: Manchester

Re: Forum Search limitations

Postby danielj » Mon Jun 06, 2016 7:26 pm

I did tell you that the forum search was bobbins...

d.

User avatar
BigEd
Posts: 1500
Joined: Sun Jan 24, 2010 10:24 am
Location: West
Contact:

Re: Forum Search limitations

Postby BigEd » Mon Jun 06, 2016 7:35 pm

I am reminded of a bugtracking system I used to use at work - pretty good, but a complex search could bring it to its knees. I ended up nobbling complex searches.

User avatar
sydney
Posts: 1987
Joined: Wed May 18, 2005 9:09 am
Location: Newcastle upon Tyne

Re: Forum Search limitations

Postby sydney » Mon Jun 06, 2016 7:36 pm

MartinB wrote:I think it's clearly a content limiting conspiracy by the newly appointed orange, green and pink hierarchy.... =; [-(

I've got my eye on you! :lol:

User avatar
paulv
Posts: 3606
Joined: Tue Jan 25, 2011 6:37 pm
Location: Leicestershire
Contact:

Re: Forum Search limitations

Postby paulv » Mon Jun 13, 2016 6:02 pm

I'm really having issues with the search at the moment....

If I search for the phrase "postulations"

If returns the following result.

http://www.stardot.org.uk/forums/viewtopic.php?f=3&t=5214&p=56637&hilit=postulations#p56637

It should be returning much, much more than that.

e.g.

http://www.stardot.org.uk/forums/viewtopic.php?f=16&t=10566

this is just one extra result but I remember there were around 7 or 8 results before the upgrade..

There are many other searches that I've tried and would expect a lot more in the way of results but a good one is the search term "UPURS"....

The results appear to be missing around 12 months of indexable posts from 5th Jun 2015 to some time in Jun 2016.

Searching for "vidc enhancer" the most recent result is from the 5th of June 2015.

I looks like the last 12 months worth of posts don't seem to be indexed for many threads. Posts older than 12 month old are definitely indexed. Seems odd.

Paul

User avatar
MartinB
Posts: 4556
Joined: Mon Mar 31, 2008 9:04 pm
Location: Obscurity

Re: Forum Search limitations

Postby MartinB » Mon Jun 13, 2016 6:10 pm

Yes, I've played with it some more Paul and it seems to be really random now, missing great swathes of occurrences of a given search term. I didn't like to mention it again but since you've also noticed, I feel safety in numbers.... :wink:

User avatar
BigEd
Posts: 1500
Joined: Sun Jan 24, 2010 10:24 am
Location: West
Contact:

Re: Forum Search limitations

Postby BigEd » Mon Jun 13, 2016 6:14 pm

Looks like phpBB allows an admin to delete the index and rebuild it.

User avatar
paulv
Posts: 3606
Joined: Tue Jan 25, 2011 6:37 pm
Location: Leicestershire
Contact:

Re: Forum Search limitations

Postby paulv » Mon Jun 13, 2016 11:03 pm

Further to my previous post, the forum is happily indexing new posts to old threads that aren't showing up in the search results so the search catalog is definitely squiffy :(

Paul

User avatar
paulv
Posts: 3606
Joined: Tue Jan 25, 2011 6:37 pm
Location: Leicestershire
Contact:

Re: Forum Search limitations

Postby paulv » Sat Jul 09, 2016 9:45 am

Did anything get looked at with this? When searching I'm still seeing a hole in the results of about 1 year.

Also, did we not have a small change which allowed TLA's to be indexed? I just searched for some UEF related posts and UEF is being actively ignored from the search terms I enter, rendering the searches meaningless :(

Paul

User avatar
roland
Posts: 2808
Joined: Thu Aug 29, 2013 8:29 pm
Location: Born (NL)
Contact:

Re: Forum Search limitations

Postby roland » Thu Jul 14, 2016 8:49 pm

I just saw this topic and it looks like nobody took some action. If there's no objection I will backup the database (just in case...), delete all search indexes and recreate them. I'll do this next week sometime in the early morning.
256K + 6502 Inside
MAN WOMAN :shock:


Return to “stardot.org.uk”

Who is online

Users browsing this forum: Pernod and 1 guest