instruction-tuning

35 projects share this GitHub topic

Lines connect members that are measurably related to each other. Dot size reflects stars.

🧬 Members

LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

Awesome-Multimodal-Large-Language-Models

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

The official GitHub page for the survey paper "A Survey of Large Language Models".

Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

Aligning pretrained language models with instruction data generated by themselves.

Instruction Tuning with GPT-4

Code and models for ICML 2024 paper, NExT-GPT: Any-to-Any Multimodal Large Language Model

总结Prompt&LLM论文，开源数据&模型，AIGC应用

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained…

InternLM-XComposer

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio…

We unified the interfaces of instruction-tuning data (e.g., CoT data), multiple LLMs and parameter-efficient…

mPLUG-Owl: The Powerful Multi-modal Large Language Model Family

[ECCV2024] Video Foundation Models & Data for Multimodal Understanding

Cambrian-1 is a family of multimodal LLMs with a vision-centric design.

Synthetic data curation for post-training and structured data extraction

An Open-sourced Knowledgable Large Language Model Framework.

DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. 🤖💤

Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey

[ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation

[SIGIR'2024] "GraphGPT: Graph Instruction Tuning for Large Language Models"

Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]

Crosslingual Generalization through Multitask Finetuning

awesome-instruction-learning

Papers and Datasets on Instruction Tuning and Following. ✨✨✨

MindSpore online courses: Step into LLM

[KDD'2024] "UrbanGPT: Spatio-Temporal Large Language Models"

[CVPR 2025 Highlight] Official code for "Olympus: A Universal Task Router for Computer Vision Tasks"

CIKM2023 Best Demo Paper Award. HugNLP is a unified and comprehensive NLP library based on HuggingFace…

A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave,…

Awesome-Multimodal-LLM

Research Trends in LLM-guided Multimodal Learning.

Awesome-instruction-tuning

A curated list of awesome instruction tuning datasets, models, papers and repositories.

data_management_LLM

Collection of training data management explorations for large language models

[CVPR 2024] "LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and…

🔗 Related families

foundation-models 63 in-context-learning 20 multi-modality 15 multimodal-large-language-models 44 lora 65 visual-language-learning 6 chain-of-thought 29 pre-training 20

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.