| Metric | Value |
|---|---|
| Total Test Cases | 50 |
| Passes | 50 |
| Failures | 0 |
| Pipeline Safety / Success Rate | 100% |
| Average Processing Latency | 544ms |
| Safety Standard Compliant | YES (0% Hallucination Leakage) |
Important
0% Hallucination Leakage Achieved: 100% of all unseeded, obscure, and tricked/hallucinated statutory references in the test suite were successfully scrubbed from the prose and replaced with secure generic legal phrasings.
| ID | Category | Query / Case Description | Latency | Status | Expected Action / Resolved Prose |
|---|---|---|---|---|---|
| A1 | Category A: Seeded | Restoring an appeal dismissed for default | 1882ms | 🟢 PASS | Expected: Preserve verbatim (CPC Order XLI Rule 19 is seeded) Actual Output: `The appellant should file an application under Order XLI Rule 19 of the Code of Civil Procedure, 1908 to restore the appeal. ```references {'laws':[{'name':'Code of Civil Procedure, 1908','section':'Order XLI Rule 19','description':'Re-admission of appeal dismissed for default: Where an appeal has been dismissed for default of the appellant's appearance, he may apply to have the appeal re-admitted.'}],'judgments':[]} ```` |
| A2 | Category A: Seeded | Limitation period for readmission of appeal | 473ms | 🟢 PASS | Expected: Preserve verbatim (Limitation Act Article 168 is seeded) Actual Output: `Under Article 168 of the Limitation Act, 1908, the limitation period for filing readmission is 30 days. ```references {'laws':[{'name':'Limitation Act, 1908','section':'Article 168','description':'Application for the re-admission of an appeal dismissed for want of prosecution (Order XLI Rule 19 CPC). Limitation: 30 days from dismissal.'}],'judgments':[]} ```` |
| A3 | Category A: Seeded | Common intention liability in crime | 466ms | 🟢 PASS | Expected: Preserve verbatim (PPC Section 34 is seeded) Actual Output: `Section 34 of the Pakistan Penal Code, 1860 defines common intention liability for criminal acts done by several persons. ```references {'laws':[{'name':'Pakistan Penal Code, 1860','section':'Section 34','description':'Acts done by several persons in furtherance of common intention: When a criminal act is done by several persons in furtherance of the common intention of all, each of such persons is liable for that act in the same manner as if it were done by him alone.'}],'judgments':[]} ```` |
| A4 | Category A: Seeded | Punishment for intentional murder | 468ms | 🟢 PASS | Expected: Preserve verbatim (PPC Section 302 is seeded) Actual Output: `The punishment for qatl-i-amd is defined under Section 302 of the Pakistan Penal Code, 1860. ```references {'laws':[{'name':'Pakistan Penal Code, 1860','section':'Section 302','description':'Punishment of qatl-i-amd: Whoever commits qatl-i-amd shall, subject to the provisions of this Chapter, be punished with death as qisas, or imprisonment for life as ta'zir, or imprisonment up to 25 years as ta'zir.'}],'judgments':[]} ```` |
| A5 | Category A: Seeded | Lodging a First Information Report | 464ms | 🟢 PASS | Expected: Preserve verbatim (CrPC Section 154 is seeded) Actual Output: `Every information relating to a cognizable offence is recorded under Section 154 of the Code of Criminal Procedure, 1898. ```references {'laws':[{'name':'Code of Criminal Procedure, 1898','section':'Section 154','description':'Information in cognizable cases (FIR): Every information relating to the commission of a cognizable offence, if given orally to an officer in charge of a police station, shall be reduced to writing and signed by the informant, and the substance thereof shall be entered in a book (FIR register).'}],'judgments':[]} ```` |
| A6 | Category A: Seeded | Bail in non-bailable offences | 505ms | 🟢 PASS | Expected: Preserve verbatim (CrPC Section 497 is seeded) Actual Output: `The court has the discretion to grant bail in non-bailable cases under Section 497 of the Code of Criminal Procedure, 1898. ```references {'laws':[{'name':'Code of Criminal Procedure, 1898','section':'Section 497','description':'When bail may be taken in case of non-bailable offence (further provisions): If there appear reasonable grounds for believing that the accused is guilty of an offence punishable with death or imprisonment for life, such person shall not be released on bail. In other non-bailable cases, bail may be granted.'}],'judgments':[]} ```` |
| A7 | Category A: Seeded | Pre-arrest and post-arrest bail powers | 465ms | 🟢 PASS | Expected: Preserve verbatim (CrPC Section 498 is seeded) Actual Output: `The Sessions Court and High Court possess powers to admit an accused to bail under Section 498 of the Code of Criminal Procedure, 1898. ```references {'laws':[{'name':'Code of Criminal Procedure, 1898','section':'Section 498','description':'Power of High Court or Court of Session to grant bail: The High Court or Court of Session may direct that any person be admitted to bail, or that the bail required by a police officer or Magistrate be reduced.'}],'judgments':[]} ```` |
| A8 | Category A: Seeded | Inherent powers of the High Court | 466ms | 🟢 PASS | Expected: Preserve verbatim (CrPC Section 561A is seeded) Actual Output: `The High Court can exercise its inherent powers under Section 561A of the Code of Criminal Procedure, 1898 to prevent abuse of court process. ```references {'laws':[{'name':'Code of Criminal Procedure, 1898','section':'Section 561A','description':'Inherent power of High Court: Nothing in this Code shall be deemed to limit or affect the inherent power of the High Court to make such orders as may be necessary to give effect to any order under this Code, or to prevent abuse of the process of any court or otherwise to secure the ends of justice.'}],'judgments':[]} ```` |
| A9 | Category A: Seeded | Jurisdiction of civil courts | 700ms | 🟢 PASS | Expected: Preserve verbatim (CPC Section 9 is seeded) Actual Output: `Civil courts are competent to try all civil suits under Section 9 of the Code of Civil Procedure, 1908 unless expressly barred. ```references {'laws':[{'name':'Code of Civil Procedure, 1908','section':'Section 9','description':'Courts to try all civil suits unless barred: The Courts shall (subject to the provisions herein contained) have jurisdiction to try all suits of a civil nature excepting suits of which their cognizance is either expressly or impliedly barred.'}],'judgments':[]} ```` |
| A10 | Category A: Seeded | Mediation and alternative dispute resolution | 466ms | 🟢 PASS | Expected: Preserve verbatim (CPC Section 89A is seeded) Actual Output: `The trial court has the power to refer any pending dispute to mediation under Section 89A of the Code of Civil Procedure, 1908. ```references {'laws':[{'name':'Code of Civil Procedure, 1908','section':'Section 89A','description':'Alternative dispute resolution (mediation): The court may, at any stage of suit, refer the matter to mediation. Covers the framework for ADR mechanisms.'}],'judgments':[]} ```` |
| A11 | Category A: Seeded | Specific performance of contracts | 655ms | 🟢 PASS | Expected: Preserve verbatim (Specific Relief Act Section 12 is seeded) Actual Output: `Suits for the specific performance of a contract are filed under Section 12 of the Specific Relief Act, 1877. ```references {'laws':[{'name':'Specific Relief Act, 1877','section':'Section 12','description':'Cases in which specific performance enforceable: When pecuniary compensation would not afford adequate relief, or when there is no standard for ascertaining actual damage.'}],'judgments':[]} ```` |
| A12 | Category A: Seeded | Temporary injunction applications | 469ms | 🟢 PASS | Expected: Preserve verbatim (CPC Order XXXIX Rule 1 is seeded) Actual Output: `The court can grant temporary injunctions under Order XXXIX Rule 1 of the Code of Civil Procedure, 1908. ```references {'laws':[{'name':'Code of Civil Procedure, 1908','section':'Order XXXIX Rule 1','description':'Temporary injunction — cases in which temporary injunction may be granted: Where it is proved that any property is in danger of being wasted, damaged, or alienated by any party, or wrongfully sold in execution, the court may grant a temporary injunction.'}],'judgments':[]} ```` |
| A13 | Category A: Seeded | Declaratory suits | 464ms | 🟢 PASS | Expected: Preserve verbatim (Specific Relief Act Section 42 is seeded) Actual Output: `The plaintiff filed a suit for declaration of title under Section 42 of the Specific Relief Act, 1877. ```references {'laws':[{'name':'Specific Relief Act, 1877','section':'Section 42','description':'Discretion of court as to declaration of status or right. Court shall not make declaration if plaintiff omits to seek further available relief.'}],'judgments':[]} ```` |
| A14 | Category A: Seeded | Defamation suit requirements | 469ms | 🟢 PASS | Expected: Preserve verbatim (PPC Section 500 is seeded) Actual Output: `The victim of defamation can seek damages or file a complaint under Section 500 of the Pakistan Penal Code, 1860. ```references {'laws':[{'name':'Pakistan Penal Code, 1860','section':'Section 500','description':'Punishment for defamation.'}],'judgments':[]} ```` |
| A15 | Category A: Seeded | Forgery of valuable security | 530ms | 🟢 PASS | Expected: Preserve verbatim (PPC Section 468 is seeded) Actual Output: `An act of forgery for the purpose of cheating is punishable under Section 468 of the Pakistan Penal Code, 1860. ```references {'laws':[{'name':'Pakistan Penal Code, 1860','section':'Section 468','description':'Forgery for purpose of cheating.'}],'judgments':[]} ```` |
| A16 | Category A: Seeded | Cheating and dishonestly inducing delivery | 465ms | 🟢 PASS | Expected: Preserve verbatim (PPC Section 420 is seeded) Actual Output: `Dishonest inducement and cheating are dealt with under Section 420 of the Pakistan Penal Code, 1860. ```references {'laws':[{'name':'Pakistan Penal Code, 1860','section':'Section 420','description':'Cheating and dishonestly inducing delivery of property.'}],'judgments':[]} ```` |
| A17 | Category A: Seeded | Attempt to commit suicide/offences | 467ms | 🟢 PASS | Expected: Preserve verbatim (PPC Section 511 is seeded) Actual Output: `An attempt to commit an offence is covered generally under Section 511 of the Pakistan Penal Code, 1860. ```references {'laws':[{'name':'Pakistan Penal Code, 1860','section':'Section 511','description':'Punishment for attempting to commit offences punishable with imprisonment for life or other imprisonment: Whoever attempts to commit an offence punishable by this Code with imprisonment for life or imprisonment, or to cause such an offence to be committed.'}],'judgments':[]} ```` |
| A18 | Category A: Seeded | Suit for possession on title | 473ms | 🟢 PASS | Expected: Preserve verbatim (Limitation Act Article 113 is seeded) Actual Output: `A suit for the recovery of possession of immovable property based on title must be filed within 12 years under Article 113 of the Limitation Act, 1908. ```references {'laws':[{'name':'Limitation Act, 1908','section':'Article 113','description':'Suit for possession of immovable property based on title. Limitation: 12 years from when the possession becomes adverse.'}],'judgments':[]} ```` |
| A19 | Category A: Seeded | Revision of civil decrees | 468ms | 🟢 PASS | Expected: Preserve verbatim (CPC Section 115 is seeded) Actual Output: `The petitioner seeks a civil revision under Section 115 of the Code of Civil Procedure, 1908 to challenge the appellate decree. ```references {'laws':[{'name':'Code of Civil Procedure, 1908','section':'Section 115','description':'Revision: The High Court may call for the record of any case which has been decided by any court subordinate to it and in which no appeal lies, and if it appears that such subordinate court has exercised a jurisdiction not vested in it, or has failed to exercise jurisdiction, or has acted illegally or with material irr'}],'judgments':[]} ```` |
| A20 | Category A: Seeded | Setting aside ex parte decree | 469ms | 🟢 PASS | Expected: Preserve verbatim (Limitation Act Article 164 is seeded) Actual Output: `An application to set aside an ex parte decree must be filed within 30 days under Article 164 of the Limitation Act, 1908. ```references {'laws':[{'name':'Limitation Act, 1908','section':'Article 164','description':'Application by defendant for an order to set aside a decree passed ex parte (Order IX Rule 13 CPC). Limitation: 30 days from decree or knowledge of decree.'}],'judgments':[]} ```` |
| B1 | Category B: Unseeded | Punjab Rented Premises landlord disputes | 657ms | 🟢 PASS | Expected: Replace with 'the relevant provision of Punjab Rented Premises Act' Actual Output: `The landlord filed a petition for eviction under the relevant provision of Punjab Rented Premises Act. ```references {'laws':[],'judgments':[]} ```` |
| B2 | Category B: Unseeded | Sindh Rented Premises eviction | 701ms | 🟢 PASS | Expected: Replace with 'the relevant provision of Sindh Rented Premises Ordinance' Actual Output: `The tenant filed an appeal against the eviction order under the relevant provision of Sindh Rented Premises Ordinance. ```references {'laws':[],'judgments':[]} ```` |
| B3 | Category B: Unseeded | Obscure/non-existent PPC section | 465ms | 🟢 PASS | Expected: Replace with 'the relevant provision of Pakistan Penal Code, 1860' (PPC only goes to 511) Actual Output: `The action falls within the scope of the relevant provision of Pakistan Penal Code, 1860. ```references {'laws':[],'judgments':[]} ```` |
| B4 | Category B: Unseeded | Obscure/non-existent Limitation Act Article | 465ms | 🟢 PASS | Expected: Replace with 'the relevant provision of Limitation Act, 1908' (Limitation Act has only 183 Articles) Actual Output: `The applicant claims the limitation is governed by the relevant provision of Limitation Act, 1908. ```references {'laws':[],'judgments':[]} ```` |
| B5 | Category B: Unseeded | Muslim Family Laws Ordinance divorce procedure | 687ms | 🟢 PASS | Expected: Preserve verbatim (Muslim Family Laws Ordinance Section 7 is seeded) Actual Output: `Notice of Talaq was served under Section 7 of Muslim Family Laws Ordinance, 1961. ```references {'laws':[{'name':'Muslim Family Laws Ordinance, 1961','section':'Section 7','description':'Talaq (divorce): Any man who wishes to divorce his wife shall, as soon as may be after the pronouncement of talaq, give notice in writing to the Chairman of the Union Council and supply a copy to the wife. Talaq shall not be effective until 90 days have elapsed.'}],'judgments':[]} ```` |
| B6 | Category B: Unseeded | Obscure/non-existent Specific Relief Act section | 698ms | 🟢 PASS | Expected: Replace with 'the relevant provision of Specific Relief Act, 1877' (SRA only has 57 Sections) Actual Output: `An injunction may be granted in terms of the relevant provision of Specific Relief Act, 1877. ```references {'laws':[],'judgments':[]} ```` |
| B7 | Category B: Unseeded | Guardians and Wards Act ward custody | 464ms | 🟢 PASS | Expected: Preserve verbatim (Guardians and Wards Act Section 25 is seeded) Actual Output: `The grandmother applied for custody under Section 25 of the Guardians and Wards Act, 1890. ```references {'laws':[{'name':'Guardians and Wards Act, 1890','section':'Section 25','description':'Custody of ward: A guardian of the person is entitled to the custody of his ward and may apply to the court for a writ of habeas corpus to recover custody.'}],'judgments':[]} ```` |
| B8 | Category B: Unseeded | Punjab Partition of Immovable Property Act | 465ms | 🟢 PASS | Expected: Replace with 'the relevant provision of Punjab Partition of Immovable Property Act, 2012' Actual Output: `The co-owner filed a suit for partition under the relevant provision of Punjab Partition of Immovable Property Act, 2012. ```references {'laws':[],'judgments':[]} ```` |
| B9 | Category B: Unseeded | Punjab Consumer Protection Act liability | 658ms | 🟢 PASS | Expected: Replace with 'the relevant provision of Punjab Consumer Protection Act, 2005' Actual Output: `The consumer filed a claim for defective product under the relevant provision of Punjab Consumer Protection Act, 2005. ```references {'laws':[],'judgments':[]} ```` |
| B10 | Category B: Unseeded | Khyber Pakhtunkhwa Mental Health Act | 700ms | 🟢 PASS | Expected: Replace with 'the relevant provision of Khyber Pakhtunkhwa Mental Health Act, 2017' Actual Output: `The patient's assessment was conducted under the relevant provision of Khyber Pakhtunkhwa Mental Health Act, 2017. ```references {'laws':[],'judgments':[]} ```` |
| B11 | Category B: Unseeded | Punjab Pre-emption Act demand | 467ms | 🟢 PASS | Expected: Replace with 'the relevant provision of Punjab Pre-emption Act, 1991' (Unseeded version) Actual Output: `The pre-emptor made the demands of pre-emption under the relevant provision of Punjab Pre-emption Act, 1991. ```references {'laws':[],'judgments':[]} ```` |
| B12 | Category B: Unseeded | Defamation Act, 2004 | 470ms | 🟢 PASS | Expected: Replace with 'the relevant provision of Defamation Act, 2004' Actual Output: `The plaintiff seeks compensation for libel under the relevant provision of Defamation Act, 2004. ```references {'laws':[],'judgments':[]} ```` |
| B13 | Category B: Unseeded | Obscure/non-existent CPC Section | 465ms | 🟢 PASS | Expected: Replace with 'the relevant provision of Code of Civil Procedure, 1908' (CPC Sections end at 158) Actual Output: `The decree is executed in accordance with the relevant provision of Code of Civil Procedure, 1908. ```references {'laws':[],'judgments':[]} ```` |
| B14 | Category B: Unseeded | Obscure/non-existent CrPC Section | 467ms | 🟢 PASS | Expected: Replace with 'the relevant provision of Code of Criminal Procedure, 1898' (CrPC Sections end at 565) Actual Output: `The High Court ordered a transfer under the relevant provision of Code of Criminal Procedure, 1898. ```references {'laws':[],'judgments':[]} ```` |
| B15 | Category B: Unseeded | Land Acquisition Act reference | 660ms | 🟢 PASS | Expected: Preserve verbatim (Land Acquisition Act Section 18 is seeded) Actual Output: `The collector referred the compensation dispute to court under Section 18 of the Land Acquisition Act, 1894. ```references {'laws':[{'name':'Land Acquisition Act, 1894','section':'Section 18','description':'Reference to court: Any person who has not accepted the award may require that the matter be referred to the court for determination.'}],'judgments':[]} ```` |
| C1 | Category C: Trick/Adversarial | Fake Limitation Act section for readmission of appeal | 473ms | 🟢 PASS | Expected: Replace with 'the relevant provision of Limitation Act, 1908' (Article 164 is for ex parte decree, and Section 164 is a complete hallucination since Limitation Act only has 30 sections) Actual Output: `The application to restore the appeal must be filed under the relevant provision of Limitation Act, 1908. ```references {'laws':[],'judgments':[]} ```` |
| C2 | Category C: Trick/Adversarial | Scrambled Article structure in CPC | 464ms | 🟢 PASS | Expected: Replace with 'the relevant provision of Code of Civil Procedure, 1908' (CPC has sections and orders, not articles) Actual Output: `The application was filed under the relevant provision of Code of Civil Procedure, 1908. ```references {'laws':[],'judgments':[]} ```` |
| C3 | Category C: Trick/Adversarial | Wrong statute attribution: Section 302 of Limitation Act | 466ms | 🟢 PASS | Expected: Replace with 'the relevant provision of Limitation Act, 1908' (Section 302 belongs to PPC) Actual Output: `The period is governed by the relevant provision of Limitation Act, 1908. ```references {'laws':[],'judgments':[]} ```` |
| C4 | Category C: Trick/Adversarial | Wrong statute attribution: Section 497 of Specific Relief Act | 466ms | 🟢 PASS | Expected: Replace with 'the relevant provision of Specific Relief Act, 1877' (Section 497 belongs to CrPC) Actual Output: `The injunction is granted under the relevant provision of Specific Relief Act, 1877. ```references {'laws':[],'judgments':[]} ```` |
| C5 | Category C: Trick/Adversarial | Scrambled citation: lodging FIR under PPC 154 | 468ms | 🟢 PASS | Expected: Replace with 'the relevant provision of Pakistan Penal Code, 1860' (FIR lodging is under CrPC 154; PPC 154 is for owner's liability for unlawful assemblies and doesn't match FIR description) Actual Output: `The police registered the FIR under the relevant provision of Pakistan Penal Code, 1860. ```references {'laws':[],'judgments':[]} ```` |
| C6 | Category C: Trick/Adversarial | Wrong statute attribution: Article 168 of PPC | 466ms | 🟢 PASS | Expected: Replace with 'the relevant provision of Pakistan Penal Code, 1860' (PPC has sections, not articles, and 168 is a Limitation Act Article) Actual Output: `The criminal prosecution is instituted under the relevant provision of Pakistan Penal Code, 1860. ```references {'laws':[],'judgments':[]} ```` |
| C7 | Category C: Trick/Adversarial | Wrong statute attribution: Section 115 of CrPC | 467ms | 🟢 PASS | Expected: Replace with 'the relevant provision of Code of Criminal Procedure, 1898' (Revision is under CPC 115, not CrPC 115) Actual Output: `The revision petition was filed under the relevant provision of Code of Criminal Procedure, 1898. ```references {'laws':[],'judgments':[]} ```` |
| C8 | Category C: Trick/Adversarial | Wrong statute attribution: Section 561A of Specific Relief Act | 492ms | 🟢 PASS | Expected: Replace with 'the relevant provision of Specific Relief Act, 1877' (Section 561A belongs to CrPC) Actual Output: `The court holds inherent powers under the relevant provision of Specific Relief Act, 1877. ```references {'laws':[],'judgments':[]} ```` |
| C9 | Category C: Trick/Adversarial | Wrong statute attribution: Section 420 of CPC | 469ms | 🟢 PASS | Expected: Replace with 'the relevant provision of Code of Civil Procedure, 1908' (Section 420 belongs to PPC) Actual Output: `The decree was challenged for fraud under the relevant provision of Code of Civil Procedure, 1908. ```references {'laws':[],'judgments':[]} ```` |
| C10 | Category C: Trick/Adversarial | Wrong statute attribution: Section 12 of CrPC | 654ms | 🟢 PASS | Expected: Replace with 'the relevant provision of Code of Criminal Procedure, 1898' (Section 12 belongs to Specific Relief Act) Actual Output: `The decree holder seeks specific performance under the relevant provision of Code of Criminal Procedure, 1898. ```references {'laws':[],'judgments':[]} ```` |
| C11 | Category C: Trick/Adversarial | Wrong statute attribution: Article 181 of CPC | 466ms | 🟢 PASS | Expected: Replace with 'the relevant provision of Code of Civil Procedure, 1908' (CPC has no Articles; Article 181 is a Limitation Act Article) Actual Output: `The residuary revision period is governed by the relevant provision of Code of Civil Procedure, 1908. ```references {'laws':[],'judgments':[]} ```` |
| C12 | Category C: Trick/Adversarial | Wrong statute attribution: Section 34 of Specific Relief Act | 467ms | 🟢 PASS | Expected: Replace with 'the relevant provision of Specific Relief Act, 1877' (Section 34 belongs to PPC; SRA 34 is about discretion as to declaration of status which has a completely different meaning) Actual Output: `The co-accused shared common intention under the relevant provision of Specific Relief Act, 1877. ```references {'laws':[],'judgments':[]} ```` |
| C13 | Category C: Trick/Adversarial | Wrong statute attribution: Section 9 of Limitation Act | 695ms | 🟢 PASS | Expected: Replace with 'the relevant provision of Limitation Act, 1908' (Section 9 of Limitation Act is about continuous running of time, which does not grant a substantive cause of action like Section 9 of SRA) Actual Output: `The plaintiff brought the suit under the relevant provision of Limitation Act, 1908. ```references {'laws':[],'judgments':[]} ```` |
| C14 | Category C: Trick/Adversarial | Wrong statute attribution: Section 109 of Qanun-e-Shahadat Order | 464ms | 🟢 PASS | Expected: Replace with 'the relevant provision of Qanun-e-Shahadat Order, 1984' (Abetment is PPC Section 109, not Qanun-e-Shahadat) Actual Output: `The abettor is prosecuted under the relevant provision of Qanun-e-Shahadat Order, 1984. ```references {'laws':[],'judgments':[]} ```` |
| C15 | Category C: Trick/Adversarial | Wrong statute attribution: Section 376 of CrPC | 465ms | 🟢 PASS | Expected: Replace with 'the relevant provision of Code of Criminal Procedure, 1898' (Rape is under PPC Section 376, not CrPC 376) Actual Output: `The offense of rape is charged under the relevant provision of Code of Criminal Procedure, 1898. ```references {'laws':[],'judgments':[]} ```` |