Demo
BM25 retrieval over sample LePaRD corpus + gpt-4o-mini generation + gpt-4o-mini faithfulness judge — matching MS4 implementation.
Ask the Legal RAG System
Pipeline Architecture
Query → BM25(k1=1.5,b=0.75) top-5 chunks → gpt-4o-mini generation (grounded) → gpt-4o-mini judge (FAITHFUL/PARTIAL/HALLUCINATED)
Sample corpus: 30 federal appellate opinion chunks. Hard negatives: 7,442 train pairs. Fine-tuning: lr=2e-5, batch=32, 2 epochs, 22 GPU-hours.
Sample Test Questions
Copy and paste into the query box above to test different faithfulness outcomes.
Likely FAITHFUL
- What is the standard for qualified immunity?
- What are the exceptions to the Fourth Amendment warrant requirement?
- How does Brady v. Maryland define prosecutorial disclosure obligations?
- What test does Strickland v. Washington establish for ineffective assistance of counsel?
- What must a plaintiff prove to establish standing under Lujan v. Defenders of Wildlife?
- What is the Chevron deference doctrine?
- How does Miranda v. Arizona define custodial interrogation?
- What factors does Graham v. Connor use to evaluate excessive force claims?
- What is required for federal diversity jurisdiction under 28 U.S.C. § 1332?
- How does the Eighth Amendment apply to prisoner medical care?
Likely PARTIAL
- How does ERISA preempt state insurance regulations?
- What constitutes a hostile work environment under Title VII?
- How does the Fourth Amendment excessive force standard apply to pretrial detainees versus convicted prisoners?
- What constitutional standards apply when police use deadly force during a warrantless arrest?
- How do due process protections under Mathews v. Eldridge apply to prisoner disciplinary hearings?
- How does sovereign immunity limit civil rights claims against federal officers under Bivens?
- What standing requirements must a plaintiff meet to challenge an unconstitutional search?
Likely HALLUCINATED
- What is the legal standard for asylum claims based on political persecution?
- How does the Foreign Sovereign Immunities Act apply to state-sponsored terrorism?
- What are the requirements for class certification under Rule 23?
- How does the Confrontation Clause apply to hearsay in criminal trials?
- What is the standard for preliminary injunctions in patent cases?
- How does the Americans with Disabilities Act define reasonable accommodation?