🚀 Market Intelligence Agent v2.0

Let me introduce a production-ready, advanced market intelligence platform powered by multi-agent AI workflows, real-time data integration, and interactive dashboards using Streamlit that automate the end-to-end process of data aggregation, insight generation, and decision support for strategic business planning.

🌟 New Features in v2.0

🔥 Real-Time Data Integration

• Firecrawl.dev: Advanced web scraping and content extraction
• NewsData.io: Real-time news aggregation and filtering
• Enhanced Search: Intelligent content discovery and processing

🤖 Multi-Agent AI Workflow

• Reader Agent: Data collection and processing
• Analyst Agent: Trend analysis and opportunity identification
• Strategist Agent: Strategic recommendations and planning
• Formatter Agent: Report generation and export

📊 Interactive Dashboard

• Plotly Visualizations: Dynamic, interactive charts
• Real-time Updates: Live data refresh and filtering
• Export Options: PDF, DOCX, JSON, and Notion integration

🧠 AI Assistant

• Groq-Powered: Fast LLaMA3 inference for instant responses
• Context-Aware: Understands your analysis data
• Persistent Memory: Conversation history and learning
• Smart Suggestions: Relevant prompts and actions

🛠️ Technology Stack

Component	Technology
Frontend	Streamlit + Plotly + Custom Components
AI Workflow	LangGraph + Multi-Agent Architecture
LLMs	Google Gemini 2.0 + Groq LLaMA3
Data Sources	Firecrawl + NewsData.io + Tavily
Visualization	Plotly + Matplotlib + Seaborn
Export	ReportLab + python-docx + Notion API
Database	SQLite + FAISS Vector Store

📦 Installation & Setup

1. Clone Repository

```bash git clone cd market_intel_streamlit_app ```

2. Install Dependencies

```bash pip install -r requirements.txt ```

3. Environment Configuration

```bash cp .env.example .env ```

Edit .env with your API keys: ```env

Core APIs (Required)

GOOGLE_API_KEY=your_google_api_key_here

TAVILY_API_KEY=your_tavily_api_key_here

FIRECRAWL_API_KEY=your_firecrawl_api_key_here

NEWSDATA_IO_KEY=your_newsdata_io_key_here

GROQ_API_KEY=your_groq_api_key_here

Optional

NOTION_API_KEY=your_notion_api_key_here ```

4. API Key Setup Guide

🔑 Required API Keys

Google Gemini API

1. Visit Google AI Studio
2. Create new API key
3. Copy to .env file

Tavily Search API

1. Visit Tavily
2. Sign up and get API key
3. Copy to .env file

Firecrawl API

1. Visit Firecrawl.dev
2. Sign up for account
3. Get API key from dashboard
4. Copy to .env file

NewsData.io API

1. Visit NewsData.io
2. Create account
3. Get API key
4. Copy to .env file

Groq API

1. Visit Groq
2. Sign up for account
3. Get API key
4. Copy to .env file

🚀 Running the Application

```bash streamlit run app.py ```

The application will open at http://localhost:8501

🎯 Feature Walkthrough

🏠 Home Tab - Multi-Agent Analysis

• Enhanced Input: Query, market domain, and specific questions
• Advanced Options: Data source selection and analysis depth
• Real-time Progress: Live agent status and workflow tracking
• Quick Actions: Direct navigation to results

📊 Dashboard Tab - Interactive Analytics

• Dynamic Charts: Plotly-powered interactive visualizations
• Filtering: Real-time data filtering and exploration
• Multiple Views: Trends, opportunities, strategy, and timeline
• Export Options: Chart and data export functionality

📄 Report Tab - Comprehensive Analysis

• Structured Reports: AI-generated markdown reports
• Multiple Formats: PDF, DOCX, and Notion export
• Chart Integration: Embedded visualizations
• Download Options: Complete analysis packages

🤖 Assistant Tab - AI-Powered Chat

• Context-Aware: Understands your current analysis
• Fast Responses: Groq-powered instant inference
• Smart Suggestions: Pre-built prompts and actions
• Persistent Memory: Conversation history and learning

📚 History Tab - Analysis Management

• Session Management: Load and manage previous analyses
• Bulk Operations: Export and delete multiple analyses
• Search & Filter: Find specific analyses quickly
• Analytics: Usage statistics and insights

🔧 Architecture Overview

Multi-Agent Workflow

``` Input → Reader Agent → Analyst Agent → Strategist Agent → Formatter Agent → Output ↓ ↓ ↓ ↓ Data Collection Analysis Strategy Planning Report Generation - Web Scraping - Trends - Recommendations - Charts - News APIs - Opportunities - Action Plans - Exports - Content Filter - Competitive - Risk Assessment - Dashboards ```

Data Flow

1. Collection: Reader Agent gathers data from multiple sources
2. Analysis: Analyst Agent processes data and extracts insights
3. Strategy: Strategist Agent generates recommendations and plans
4. Formatting: Formatter Agent creates reports and visualizations
5. Interaction: Assistant provides ongoing support and Q&A

🔍 Usage Examples

Basic Market Analysis

1. Enter query: "AI trends in healthcare"
2. Select domain: "Healthcare"
3. Click "Run Multi-Agent Analysis"
4. Explore results in Dashboard and Report tabs

Advanced Analysis with Assistant

1. Complete basic analysis
2. Go to Assistant tab
3. Ask: "What are the key risks in my analysis?"
4. Follow up: "How can I validate these opportunities?"

Export and Sharing

1. Navigate to Report tab
2. Choose export format (PDF/DOCX)
3. Download comprehensive report
4. Share with stakeholders

🚀 Advanced Features

Custom Agent Configuration

• Modify agent behavior in core/agents/
• Adjust analysis depth and focus areas
• Configure data source priorities

Integration Extensions

• Add new data sources in core/integrations/
• Implement custom export formats
• Extend chart generation capabilities

Dashboard Customization

• Modify visualizations in components/ui_dashboard.py
• Add new chart types and filters
• Customize metrics and KPIs

🔧 Troubleshooting

Common Issues

API Key Errors

• Verify all required API keys are set in .env
• Check API key validity and quotas
• Ensure proper formatting (no extra spaces)

Import Errors

• Run pip install -r requirements.txt
• Check Python version compatibility (3.8+)
• Verify virtual environment activation

Performance Issues

• Reduce analysis depth for faster results
• Limit data sources for quicker processing
• Check internet connection for API calls

Chart Generation Failures

• Ensure sufficient data for visualization
• Check Plotly and Matplotlib installations
• Verify output directory permissions

Debug Mode

Enable debug logging by setting in .env: ```env LOG_LEVEL=DEBUG ```

🤝 Contributing

1. Fork the repository
2. Create feature branch: git checkout -b feature/amazing-feature
3. Commit changes: git commit -m 'Add amazing feature'
4. Push to branch: git push origin feature/amazing-feature
5. Open Pull Request

📄 License

This project is licensed under the MIT License - see the LICENSE file for details.

🙏 Acknowledgments

• Google Gemini for advanced language understanding
• Groq for fast inference capabilities
• Firecrawl for intelligent web scraping
• NewsData.io for real-time news aggregation
• Streamlit for the amazing web framework
• Plotly for interactive visualizations
• LangChain for AI workflow orchestration

📞 Support

For support, questions, or feature requests:

• Create an issue on GitHub
• Check the troubleshooting section
• Review the documentation

📄 License

This project is licensed under the MIT License - see the MIT License file for details.

---

🚀 Market Intelligence Agent v2.0 - Transforming market research with AI-powered multi-agent workflows. ```