Introduction to Web Content
Below is a structured guide on how to download Home Depot Web Content data.
Setup Your Enviroment
from carbonarc.hub import HubAPIClient
import os
host = "https://api.carbonarc.co"
TOKEN = os.getenv("TOKEN")
client = HubAPIClient(token=TOKEN, host=host)
Check Subscribed Feeds
ca.get_subscribed_feeds()
Check Subscribed Feeds IDs
feeds = client.get_subscribed_feeds()
print("Subscribed Feeds:")
for feed in feeds:
print(f"- {feed['webcontent_name']} (id: {feed['webcontent_id']})")
Fetch Manifest Files
manifest = ca.get_webcontent_manifest(webcontent_id=2) #ID 2 is HomeDepot.com in this example
import json
print(json.dumps(manifest, indent=2))
Download Web Content Files
Download Web Content Files on HomeDepot.com
ca.get_webcontent_file(file_name = 'INSERT FILE')