
MyTherapist.ng - Online Therapy for Nigerians
Mytherapist.ng is a platform that connects individuals seeking mental health support with licensed and certified therapists.

A high-performance automation tool that forces Google to crawl your site instantly. Parses sitemaps, manages Service Account auth, and utilizes the Google Indexing API to cut indexing time from weeks to minutes.
In the world of SEO, speed is revenue. You can write the best content or build the most dynamic programmatic pages, but if Google doesn't index them, they don't exist. For developers and content strategists, the most frustrating status message in Google Search Console is "Discovered - currently not indexed."
Traditional indexing is passive. You update a sitemap and wait for Googlebot to decide it's time to visit. For large sites or fresh news portals, this latency—often spanning days or weeks—is unacceptable.
I built the Google Indexer & Instant SEO Submitter to solve this specific latency problem. It turns SEO from a passive waiting game into an active, programmatic workflow.
The core technical challenge wasn't just "calling an API." It was creating a system that could bridge the gap between a developer's raw content list (sitemaps) and Google's strict security requirements, all while handling scale.
Google assigns every site a crawl budget. If you launch 1,000 new programmatic pages, Google might only crawl 50 a day. At that rate, it takes nearly a month to get fully indexed.
The Google Indexing API requires a Service Account with a specific set of permissions and a JSON key file. It is not a simple API Key interaction; it involves OAuth2 signaling and JWT signing. The tool needed to accept these sensitive credentials securely from the user without storing them permanently.
Modern sitemaps aren't just flat lists of URLs. They are often Sitemap Indices—parents pointing to children, which point to other children. A robust tool needs to traverse this tree structure to find every single indexable URL.
The solution is built as an Apify Actor using TypeScript and Node.js. I chose the Actor model because it provides a serverless environments that creates ephemeral containers for each run, ensuring user credentials (the Service Account JSON) are never persisted beyond the execution context.
googleapis library for native interaction with Google’s endpoints.xml2js for transforming XML sitemap streams into usable JavaScript objects.Here is how the system processes a request:
<sitemapindex>, it recursively fetches child sitemaps in parallel.URL_UPDATED or URL_DELETED requests to Google.// Recursively fetch sitemaps (Simplified snippet)
async function fetchAndParseSitemap(url: string): Promise<Set<string>> {
const urls = new Set<string>();
const xml = await fetch(url).then(res => res.text());
const result = await parseStringPromise(xml);
// Handle Sitemap Index (Recursion)
if (result.sitemapindex) {
const childMaps = result.sitemapindex.sitemap;
await Promise.all(childMaps.map(m => fetchAndParseSitemap(m.loc[0])));
}
// Handle Standard UrlSet
if (result.urlset) {
result.urlset.url.forEach(u => urls.add(u.loc[0]));
}
return urls;
}
During beta testing with a user who had 50,000 pages, the Actor crashed. We hit Google's rate limit: HTTP 429 (Too Many Requests).
I realized that simply "awaiting" promises wasn't enough. I had to implement an intelligent backoff strategy. I built a wrapper around the API calls that detects 429 errors and automatically pauses the execution thread.
if (error.code === 429) {
console.warn('Hit rate limit (429). Pausing for 60s...');
await new Promise(resolve => setTimeout(resolve, 60000));
// Retry logic ensues...
}
This simple addition turned a fragile script into a production-grade tool that can run for hours without supervision, respecting Google's quotas while maximizing throughput.
The results have been transformative for users relying on freshness:
I am currently working on expanding the capabilities of this tool:
Stop waiting for Googlebot. Take control of your SEO destiny.
To see this tool in action or integrate it into your own pipeline:

Mytherapist.ng is a platform that connects individuals seeking mental health support with licensed and certified therapists.

DALC, LLC specializes in equal employment opportunity, diversity and inclusion, human resources, and business consulting.

Your No.1 Solution for hostel accommodation. Application for Nigerian students to easily search for hostel accommodation.