Hi and welcome to Star History Weekly #33!

If you‘re new, it's Ayra here. Each week, we curate some open-source news and take you to explore an open-source project, the Starlets. Meanwhile, we share fascinating GitHub repos daily over at @StarHistoryHQ, so make sure to follow us if you haven't already.

In Issue #33, we explored 4 Vertical LLMs fine-tuned for specific industries or domains, enhancing their performance and relevance in those areas.

AI capabilities expand across industries, forcing the era of one-size-fits-all language models giving way to specialized solutions. Vertical LLMs represent a paradigm shift where domain-specific models deliver superior performance by focusing on particular industries, use cases, and data types through targeted training and optimization.

Today we'll explore four cutting-edge vertical LLMs that are pioneering domain-specific AI excellence:

Qwen3-Coder

Qwen3-Coder is a 480B-parameter Mixture-of-Experts coding AI model with 35B active parameters. The model achieves state-of-the-art agentic coding performance through advanced reinforcement learning. It supports 256K native context length and integrates seamlessly with popular developer tools like Claude Code and Cline.

Qwen3-Coder uses 7.5T tokens with 70% code data for training while maintaining general language abilities. The model employs reinforcement learning with 20,000 parallel environments to improve multi-turn coding tasks, achieving 55.4% on SWE-Bench Verified according to the latest SWE-bench leaderboard, which evaluates models' software engineering capabilities through real-world GitHub issue resolution.

The model offers an open-source CLI tool and integrates with existing developer workflows for practical coding assistance.

Meditron

Meditron is a suite of open-source medical Large Language Models developed by EPFL, offering both 7B and 70B parameter versions adapted from Llama-2 through continued pretraining on comprehensively curated medical corpora. The models are trained on selected PubMed papers, medical guidelines, and domain-specific datasets to deliver specialized healthcare AI capabilities.

Meditron-70B supports medical exam question answering, differential diagnosis assistance, and disease information queries. While designed to encode high-quality medical knowledge, Meditron includes important safety guidelines recommending extensive testing and clinical validation before any medical applications.

Neta Lumina

Neta Lumina is a high-quality anime-style image generation model built on the open-source Lumina-Image-2.0 foundation, fine-tuned with vast corpus of anime images and multilingual tag data to deliver exceptional creative capabilities.

Neta Lumina specializes in diverse creative scenarios including Furry, Guofeng traditional Chinese aesthetics, and character design with wide coverage from popular to niche concepts.

The model features accurate natural-language understanding with excellent adherence to complex prompts and native multilingual support for Chinese, English, and Japanese. Built on the Lumina2 Diffusion Transformer framework, it supports resolutions from 1024×1024 to custom aspect ratios optimized for creative workflows.

FinGPT

FinGPT delivers open-source financial large language models that democratize Internet-scale financial data processing, offering lightweight adaptation capabilities that significantly reduce the cost.

FinGPT's full-stack framework encompasses five layers: data source layer for comprehensive market coverage, data engineering layer for real-time NLP processing, LLMs layer with LoRA fine-tuning methodologies, task layer for fundamental financial operations, and application layer showcasing practical demos.

The platform includes specialized models for financial sentiment analysis, forecasting, and multi-task financial operations across different base models. It provides cost-effective alternatives to expensive proprietary models, enables monthly or weekly updates through automatic data curation pipelines and supports RLHF for personalized robo-advisory services.

Summary

These vertical LLMs demonstrate how specialized AI models outperform general-purpose alternatives through focused training and domain-specific optimization, each model delivers superior performance in its specialized field.

As industries adopt AI at scale, vertical LLMs are becoming the foundation for professional-grade applications that demand precision and reliability in specialized domains.