Building an Async Job Aggregator with Python: Semantic Deduplication, Hybrid AI Scoring, and LLM Fallback Cascades

Dev.to AI
Generative AI

Finding a job or landing freelance contracts on platforms like Upwork and Freelancer has turned into a pure speed simulator. The most relevant postings often close within the first 10-15 minutes. But standard automation approaches - like blindly throwing every raw text into ChatGPT - fail instantly in production. You end up facing massive OpenAI API bills, unstable JSON responses from LLMs, strict Telegram Bot API rate limits, and aggressive Cloudflare blocks on corporate career pages.