Tell us what you are trying to do?
We are a university research group with people all over the world, who help us with projects, we've set up a private Toolset database to house short audio clips, which we ask research assistants to listen to and answer questions relating to that audio. This generates data for our analyses. Each entry is a page that has two audio clips, and 2-15 questions. There are often 30,000+ entries to be coded per project. To get the data off the site, the easiest way we've found is to use WordPress' export function under Tools > Export and then export the Toolset database related to that project. We have a custom Python script that tidys up the downloaded xml.
One project which currently has 37,833 entries is triggering a critical error when you try to download the results. I had a chat with WordPress and they said that it is exceeding the memory allocation given to the plugin to generate the xml export file. They recommended that I reach out to you guys to see if you have a way to export only some of the custom post type at a time so we could split the download into chunks of entries, or if there is a way to safely fetch data directly from the database.
Is there any documentation that you are following?
None
Is there a similar example that we can see?
None
What is the link to your site? hidden link
Happy to send links to entries in this project if you think that would help.
Presumably you have looked into increasing the available memory resources and you've hit the limit with your host?
>then export the Toolset database related to that project
I'm not sure what you are describing exactly, inasmuch as there is no such thing as "a Toolset database", there is the WordPress database, and Toolset data is mostly stored in the standard WordPress tables (wp_posts, wp_postmeta etc., though it does add a handful of custom tables to the database).
As the inbuilt export function at Tools > Export is based on exporting content of specified post types, I assume you mean that the data you need to export comes from a single post type, managed by Toolset.
If the in-built export functionality exceeds the capabilities of your hosted site, you could try plugin alternatives.
The most well-known options are commercial, but I just searched and found the free WP Import Export Lite plugin and it looks capable of doing what you want, I suggest giving that a try.
Thanks for your help, the plugin recommended didn't work, I kept getting an internal error 500, but I found one that did "Import WP" which was also free.
Thanks for your help, the plugin recommended didn't work, I kept getting an internal error 500, but I found one that did "Import WP" which was also free.
