LoRA Fine-tuning for Domain Expertise Challenge

Fine-tune small models using LoRA for specific domains on consumer hardware

Build Statement

Global AI models lack understanding of African legal systems, medical conditions, engineering standards, and agricultural practices, making them unreliable for professional use. A lawyer in Rwanda cannot trust AI for local law, a doctor in Ethiopia gets incorrect diagnostic suggestions, and engineers receive recommendations violating local building codes. Organizations need specialized models but lack the resources for traditional fine-tuning. Developers must demonstrate LoRA fine-tuning on consumer hardware to create domain-expert models for law, medicine, engineering, or agriculture, showing how any organization can build specialized AI without expensive infrastructure.

Full Description

The LoRA Fine-tuning for Domain Expertise Challenge invites developers to demonstrate how Low-Rank Adaptation can create specialized AI models for African professional domains using only consumer-grade hardware. This challenge addresses the need for domain-specific AI that understands local contexts, regulations, and practices.

Participants will fine-tune small language models using LoRA techniques for specific domains such as law (understanding local legal systems), medicine (recognizing regional health conditions), engineering (local construction standards), or agriculture (indigenous farming practices). The fine-tuning process must be achievable on consumer GPUs or even CPUs, making it accessible to organizations without expensive infrastructure.

Successful solutions will demonstrate significant performance improvements in domain-specific tasks, maintain general capabilities while adding specialization, document the fine-tuning process for replication, and provide benchmarks showing expertise acquisition. The system should include data preparation pipelines, training scripts, and evaluation metrics specific to the chosen domain.

We particularly value solutions that address uniquely African domain knowledge often missing from global models, create models for local languages and dialects, demonstrate cost-effective fine-tuning workflows, and provide clear guides for non-ML experts to replicate the process. The project should democratize AI customization, enabling organizations to create their own specialized models.

Submission Requirements

• Submit up to 5 supporting links (documents, demos, repositories)

• Additional text content and explanations are supported

• Ensure all materials are accessible and properly formatted

• Review your submission before final submission

Online Submission

Submit your solution online

Deadline
November 30, 2025 at 12:00 AM
Prize Pool
$500 USD + Internship
Cash Prize
$500
Organizer
Build54
Evaluation Criteria
Domain Performance 20%
Improvement in domain-specific task accuracy
Training Efficiency 18%
Ability to fine-tune on consumer hardware
Knowledge Acquisition 16%
Successful incorporation of domain expertise
Resource Requirements 14%
Accessibility on standard consumer devices
Documentation 12%
Clarity of replication instructions
Evaluation Metrics 10%
Quality of domain-specific benchmarks
African Relevance 10%
Focus on African professional contexts