Skip Navigation

[Resolved] Google App Engine 10000 file limit and toolset sites

This thread is resolved. Here is a description of the problem and solution.

Problem:
The issue here was that the user wanted to use toolset to develop wordpress website on google app engine, however there is a 10000 file limit on app engine.

Solution:

There is currently no solution for this as google app engine limits the amount of files that can be uploaded and our toolset plugins are over this 10000 file limit.

This was possible when the embedded versions of toolset existed but those are no longer available.

This support ticket is created 6 years, 11 months ago. There's a good chance that you are reading advice that it now obsolete.

This is the technical support forum for Toolset - a suite of plugins for developing WordPress sites without writing PHP.

Everyone can read this forum, but only Toolset clients can post in it. Toolset support works 6 days per week, 19 hours per day.

Sun Mon Tue Wed Thu Fri Sat
- 9:00 – 12:00 9:00 – 12:00 9:00 – 12:00 9:00 – 12:00 9:00 – 12:00 -
- 13:00 – 18:00 13:00 – 18:00 13:00 – 18:00 14:00 – 18:00 13:00 – 18:00 -

Supporter timezone: America/Jamaica (GMT-05:00)

Tagged: 

This topic contains 6 replies, has 2 voices.

Last updated by markL 6 years, 11 months ago.

Assisted by: Shane.

Author
Posts
#602735

Hi there,

I'm trying to use the "embedded versions" of the plugins to get around the file limit for GAE. Can you refer me to any documentation for installing or activating the embedded versions of views and types?

Thanks - Mark

#602757

Shane
Supporter

Languages: English (English )

Timezone: America/Jamaica (GMT-05:00)

Hi Mark,

Thank you for contacting our support forum.

When you say embedded toolset, what are you referring to ? Is there a link you are following because I know we phased out the embedded toolset in favour of this process here in the link.
https://toolset.com/documentation/user-guides/how-to-build-toolset-based-themes/

Please let me know.

Thanks,
Shane

#602815

Hi Again,

Thanks for getting back to me. The idea for embedded versions of plugins came from this forum topic:

https://toolset.com/forums/topic/types-views-cannot-upload-to-appengine-due-to-10000-file-limit/

There is one other forum topic that deals with this issue:

https://toolset.com/forums/topic/plugins-have-too-many-files-to-use-with-google-app-engine-gae/

Since this last post, I think the number of files has gone up not down.

root@dev-wp-cy-vm:/var/www/html/wp-content/plugins# ls -l
total 44

drwxr-xr-x 6 www-data www-data 4096 Dec 28 07:47 cred-frontend-editor
-rw-r--r-- 1 www-data www-data   28 Dec  6 17:29 index.php
drwxr-xr-x 9 www-data www-data 4096 Dec 16 00:29 layouts
drwxr-xr-x 6 www-data www-data 4096 Dec 17 12:59 ocean-extra
drwxr-xr-x 7 www-data www-data 4096 Dec 26 17:27 toolset-maps
drwxr-xr-x 6 www-data www-data 4096 Dec 15 21:00 types
drwxr-xr-x 7 www-data www-data 4096 Dec 16 00:29 woocommerce
drwxr-xr-x 5 www-data www-data 4096 Dec 16 00:31 woocommerce-gateway-paypal-express-checkout
drwxr-xr-x 7 www-data www-data 4096 Dec 16 00:29 woocommerce-views
drwxr-xr-x 3 www-data www-data 4096 Dec 26 16:54 wordpress-importer
drwxr-xr-x 8 www-data www-data 4096 Dec 16 00:29 wp-views
root@dev-wp-cy-vm:/var/www/html/wp-content/plugins# find . -type f | wc -l

9106

root@dev-wp-cy-vm:/var/www/html/wp-content/plugins# 

Developing a theme for deployment that requires the user to install plugins on activation will also not work in this case as the google app engine file system is not writable. All plugin and theme files must be in place prior to deployment of the app and can not be changed or added to once the app is running.

Would it be possible to elaborate on Juan's suggestions for unnecessary files from the types, layouts, cred and maps plugins. It would also be helpful if you could identify the path to the unnecessary files / directories.

Thanks again,
Mark

#603001

Shane
Supporter

Languages: English (English )

Timezone: America/Jamaica (GMT-05:00)

Hi Mark,

I understand now however we do not supply embedded plugins like this anymore.

They are done through the installer. This installer works similar to when you setup lets say woocommerce and it allows you to configure the items.

To know how to do this you will need to follow the instructions in the link below.
https://toolset.com/documentation/user-guides/how-to-build-toolset-based-themes/

Please let me know if this helps.
Thanks,
Shanee

#604359

Thanks Shane.

Because Google App Engine does not support writing to disk after an app is deployed, a theme that simply downloads the regular versions of the plugins will not be suitable. Only the uploads directory is writable once the installation is deployed on GAE. That means that all the plugins must be installed prior to deploying the app.

Can you confirm that the plugins installed by a theme created to use toolset are reduced file count versions of the regular toolset plugins? If so, I could go through the following steps.

1. Create a theme as described in your link
2. Create a new installation of wordpress and install the theme
3. Download required plugins
4. Deploy the installation as an app on GAE (assuming the file count is < 10 000 )

Thanks again,
Mark

#604413

Shane
Supporter

Languages: English (English )

Timezone: America/Jamaica (GMT-05:00)

Hi Mark,

The installer downloads the files from our site.

This is cause we do not have an embedded version of our toolset plugins but rather the full versions.

It would've been possible with the embedded versions as they contain less files but since they are no longer available then uploading the google app engine won't be possible.

Our toolset theme method with the installer as stated wouldn't work since the app can't modify the directory.

So it seems that its not possible.

Thanks,
Shane

#604415

Thanks Shane - I'll look for another solution.