Skip to main content

AI Dev

AI Develop Framework

- LlamaIndex

Data Analysis (Chat with CSV)

- PandasAI

PandasAI is a Python library that makes it easy to ask questions to your data in natural language. It helps you to explore, clean, and analyze your data using generative AI.

Chat with Dataset

Web Scraper

- Crawlee

A web scraping and browser automation library. 

    crawlee for Python
      GitHub: https://github.com/apify/crawlee-python  crawlee for Node.js
        GitHub: https://github.com/apify/crawlee 
        - ScrapeGraphAI

        ScrapeGraphAI is a open-source web scraping python library designed to usher in a new era of scraping tools.

          Indices and tables — ScrapeGraphAI documentation GitHub: https://github.com/ScrapeGraphAI/Scrapegraph-ai   Video: Scrape Any Website using llama3+Ollama+ScrapeGraphAI | Fully Local + Free #ai #llm - YouTube
          - Crew AI

          Crew AI is a collaborative working system designed to enable various artificial intelligence agents to work together as a team, efficiently accomplishing complex tasks. Each agent has a specific role, resembling a team composed of researchers, writers, and planners.

            GitHub: https://github.com/joaomdmoura/crewAI   範例:使 AI 自動爬文並生成筆記
              Video: 如何搭建一套Agent系统 GitHub: Python 程式碼 Crew AI — your own minions. How I Made AI Assistants Do My Work For… | by Csakash | Medium
              - Scraperr

              Self-hosted webscraper.

                Welcome to the Scraperr Docs | Scraperr Docs GitHub: https://github.com/jaypyles/Scraperr 
                - Crawl4AI

                Open-source LLM Friendly Web Crawler & Scraper.

                  GitHub: https://github.com/unclecode/crawl4ai 
                  - Scrapling

                  Effortless Web Scraping for the Modern Web

                    https://github.com/D4Vinci/Scrapling 

                    LLM API

                    - OpenAI API
                    - Gemini API

                    Web UI Framework

                    - Gradio

                    Gradio is the fastest way to demo your machine learning model with a friendly web interface so that anyone can use it, anywhere!

                    - Streamlit

                    Streamlit is the UI powering the LLM movement

                    AI Memory

                    AI Coding

                    - Alternative to GitHub Copilot
                    - VS Code
                    - Cursor

                    Responsible AI

                    AI Proxy

                    企業在導入 LLM 時,可能會用到多種不同的模型,這些包含商用授權與開源授權以及來自不同的服務商。為了統一管理及開發應用這些各類不同模型,建議使用 AI Proxy (AI API Gateway) 這類平台來解決,以達到下列目的:

                    • 統一 API 介接入口與格式
                    • 成本追蹤
                    • 平衡負載
                    - LiteLLM
                    - CLI Proxy API
                    - Sub2API

                    More