J-BusinessDirectory - 15k+ listings crashing site/admin

Hi,

I just installed and tested j-directory, all was running well.

to stress test I then imported 15,500 new business listings. The import ran smoothly enough and each listing by name is searchable individually. But any search broad enough to yield severl hundred results and the page fails to load.

In addition, in the admin I can't display more than 100 listings in one view. If I selcet 'display all', I'm left with a dead page again. So I can't delete the 15k listings (unless I load them up 100 at a time and click delete 155 times!)...

Anyway, the main issue here is to identify the bottleneck so I can list 15,000 businesses, and one day upto around 30,000.

I'm running on AWS and tried swapping server instance to one with 32 cores and 64gb ram but other than the site generally running a bit quicker, it didn't allviete the issue.

My suspicsion is that I need to tweak memory settings for Joomla - any help?

Hi,

Loading all business listing from the database may require a high amount of memory. It is unusual for a user to display 15.000 listings in a single page. To delete the listing we advise to empty the tables on the database.

You can truncate all tabes that start with #__jbusinessdirectory_company_ and  also xn2_jbusinessdirectory_companies table

Having 30.000 listing on the database should not be a problem. We tested with 100.000 listings and the results were OK. On high amount of listings one search parameter should be mandatory, otherwise the whole database is searched for.

Thanks,

I discovered part of the issue was displaying the map on the search form - I imagine because it was trying to shoe the location of so many listings. This has helped improve the page load times for the main page.

But the search itself is increadibly slow for any category that has more than a few hundred listing within it. Some categories will potentially have as many as 1000 listings. Don't need to display all on a single page, but the actual interrogation of the database is what seems to cause ther delay.

Also if you play around and perform a few searches, you soon find some pages fail to load at all. Suggesting something is stalling when it hits a max time/memory limit.

I'm not a database technician or developer so it's beyond my abilities to work out what the exact bottleneck is...

site is here if you want to see for yourself: www.productiondirectory.co.uk

David

The search time increase with the number of results retrieved.

I have over 70K listings I was tring to upload and it seems that only a few thousand would upload. (Maybe 6000)

Do we know yet if this is a Joomla setting for the upload and also the retrieval of listings? My stress test was a square peg vs. round hole with a hammer. I tried loading all 70k listings, I deleted them then loaded them again. I fined tuned the import file and enabled the J-BusinessDirectory URL Translator PlugIn. 

Let me know if there is a fix...I don't want to scrap this idea, but I do have a lot of listings. 

Hi,

Please try to increase the php execution time on your server and try again.

If the execution time exceeds the servers cuts the execution and the not all business listings are imported.