foundation-models

63 projects share this GitHub topic

Lines connect members that are measurably related to each other. Dot size reflects stars.

🧬 Members

Making large AI models cheaper, faster and more accessible

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

Janus-Series: Unified Multimodal Understanding and Generation Models

A Python library for anomaly detection across tabular, time series, graph, text, image, and audio data. 60+…

⚡ TabPFN: Foundation Model for Tabular Data ⚡

Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

OpenSquilla — Token-Efficient AI Agent with same budget, higher intelligence density

YuE: Open Full-song Music Generation Foundation Model, something similar to Suno.ai but open

chronos-forecasting

Chronos: Pretrained Models for Time Series Forecasting

TimeGPT-1: production ready pre-trained Time Series Foundation Model for forecasting and anomaly detection.…

LimiX: Unleashing Structured-Data Modeling Capability for Generalist Intelligence…

Code and models for ICML 2024 paper, NExT-GPT: Any-to-Any Multimodal Large Language Model

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained…

[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as…

Images to inference with no labeling (use foundation models to train supervised models).

[ECCV2024] Video Foundation Models & Data for Multimodal Understanding

awesome-llm-powered-agent

Awesome things about LLM-powered agents. Papers / Repos / Blogs / ...

[CVPR 2025] Official PyTorch Implementation of MambaVision: A Hybrid Mamba-Transformer Vision Backbone

An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and…

graph-fraud-detection-papers

A curated list of Graph/Transformer-based fraud, anomaly, and outlier detection papers & resources

Lag-Llama: Towards Foundation Models for Probabilistic Time Series Forecasting

Python library for time series forecasting using scikit-learn compatible models, statistical methods, and…

awesome-japanese-llm

日本語LLMまとめ - Overview of Japanese LLMs

KnowledgeEditingPapers

Must-read Papers on Knowledge Editing for Large Language Models.

Awesome-TimeSeries-SpatioTemporal-LM-LLM

A professional list on Large (Language) Models and Foundation Models (LLM, LM, FM) for Time Series,…

Awesome-Foundation-Models

A curated list of foundation models for vision and language tasks

Foundation-Models-Framework-Lab

A practical lab for building, testing, and evaluating apps with Apple's Foundation Models framework.

A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One…

[ECCV 2024 Best Paper Candidate & TPAMI 2025] PointLLM: Empowering Large Language Models to Understand Point…

A Python toolkit for fine-tuning Geospatial Foundation Models (GFMs).

VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models

Awesome-Robotics-3D

A curated list of 3D Vision papers relating to Robotics domain in the era of large models i.e. LLMs/VLMs,…

[MICCAI 2019 Young Scientist Award] [MEDIA 2020 Best Paper Award] Models Genesis, one of the first…

Awesome-Model-Merging-Methods-Theories-Applications

Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. ACM Computing…

Free and fully open-source L2 ADAS stack powered by End-to-End AI technology

Foundational Model for Speech Recognition Tasks

Awesome-Reasoning-Foundation-Models

✨✨Latest Papers and Benchmarks in Reasoning with Foundation Models

PyTorch Implementation of EmerNeRF: Emergent Spatial-Temporal Scene Decomposition via Self-Supervision

HoloMotion: A Foundation Model for Whole-Body Humanoid Control

[ICCV 2025 & ICCV 2025 RIWM Outstanding Paper] Aether: Geometric-Aware Unified World Modeling

tokenize-anything

[ECCV 2024] Tokenize Anything via Prompting

This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding…

[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization

Large Language & Foundation Models for Time Series.

🐦‍🔥 LangGraph for Swift — build stateful AI agent workflows natively on Apple/Linux platforms.

Heterogeneous Pre-trained Transformer (HPT) as Scalable Policy Learner.

[NeurIPS 2025 Spotlight] TPA: Tensor ProducT ATTenTion Transformer (https://arxiv.org/abs/2501.06425)

Official repo of VLABench, a large scale benchmark designed for fairly evaluating VLA, Embodied Agent, and…

Vision AI Solution Accelerator

[CVPR 2025 Highlight] Official code for "Olympus: A Universal Task Router for Computer Vision Tasks"

ai-powered-search

The codebase for the book "AI-Powered Search" (Manning Publications, 2025) and associated "AI-Powered Search:…

BioReason: Incentivizing Multimodal Biological Reasoning within a DNA-LLM Model | NeurIPS '25

Official code base for MinD-Video

A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave,…

mega-data-factory

🏭 Mega Scale Multimodal DataPipeline for SOTA Foundation Models

World Model based Autonomous Driving Platform in CARLA :car:

Production-ready data processing made easy and shareable

GRID-playground

Platform for General Robot Intelligence Development

[CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts

[ECCV 2024] Improving 2D Feature Representations by 3D-Aware Fine-Tuning

Awesome-Multimodal-LLM-Autonomous-Driving

[WACV 2024 Survey Paper] Multimodal Large Language Models for Autonomous Driving

Official implementation of Meta Prompting for AI Systems (https://arxiv.org/abs/2311.11482)

🔗 Related families

instruction-tuning 35 vision-language-model 60 time-series 57 forecasting 29 vision-transformer 39 representation-learning 21 llava 26 mllm 34

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.