How should I go about populating a Google Sheet with website metadata?

Question

I am creating a table in Google Sheets that will allow me to aggregate various metrics that are relevant for a web-based company. The website has about 3000 pages, most of which are 1000+ word blogs. So far, I am able to pull Analytics data just fine into Google Sheets and organize pages by KPIs like pageviews and pages per session.

However, a critical area that I need to import for the client are WP tags. The function "ImportXML" seemed simple enough, but fails under the stress of over 3,000 pages and is throttled to the point of being unusable. Because this solution will be implemented by my company in the future for other clients, it is not viable to divy up the data between 100 and 500 sheets merely to avoid the ImportXML throttling, as this would have to be done across potentially hundreds of websites and create unwieldy chains of imported data. For clarification from my last post, this is a website for which we have backend access, and all this information is available as WordPress fields.

The only other solution I have found thus far is to use RegexMatch. This had success with the page title as it has a relatively simple open title tag and close title tag to work with. The far more complicated array of WordPress tags (each a meta property with its own content field) does not play nice with RegexMatch here and returns errors no matter the structure.

A Google Apps Script or a creative use of functions is preferred, though I am open to any suggestions. I appreciate the help.

Answer 1

I solved this on my own. Using RegexMatch to parse the HTML as noted here gives the ability to match a regular expression, though not globally. I imported the entirety of the "single-tags" p class and then filtered out the HTML. Then, I split the tags by commas, finally adding an IFERROR formula. See below.

=IFERROR(SPLIT(REGEXREPLACE(importRegex($A7,"(<p class=.single-tags.>(.*)</p>)"),"<[^>]*>",""),","),"(none)")

Now you can put this into a pivot table and organize by tags, looking at key metrics by your WP tags. No thanks to anyone here, had to develop this on my own.