q5_error_analysis_selected_cases.csv

question,gold_answer,predicted_answer,exact_match,token_f1,gold_in_top20,gold_in_topk,gold_rank,categories,top_retrieved_snippet,gold_passage_snippet,manual_note,qid
who sang i'm giving up on you,A Great Big World and Christina Aguilera,Diana Ross,0,0.0,False,False,,['Retrieval miss'],"`` I 'm Coming Out '' One of the cover arts for German vinyl singles Single by Diana Ross from the album Diana B - side `` Give Up '' `` Friend to Friend '' `` Never Say I Do n't Love You '' `` My Old Piano '' Released August 22 , 1980 ( 1980 - 08 - 22 ) Format 7 `` , 12 '' Recorded December 1979 Ge...","`` Say Something '' Single by A Great Big World and Christina Aguilera from the album Is There Anybody Out There ? Released September 3 , 2013 ( 2013 - 09 - 03 ) Format CD digital download Recorded 2013 Genre Indie pop Length 3 : 49 Label Epic Songwriter ( s ) Ian Axel Chad King Mike Campbell Produc...",,-1991117775599650072
where is cuba located on a world map,22 ° 00 ′ N 80 ° 00 ′ W,Near Santiago,0,0.0,False,False,,['Retrieval miss'],"Battle of San Juan Hill Part of the Spanish -- American War Detail from Charge of the 24th and 25th Colored Infantry at San Juan Hill , July 1 , 1898 . Date 1 July 1898 Location Near Santiago , Cuba 20 ° 01 ′ 15 '' N 75 ° 47 ′ 58 '' W  /  20.02083 ° N 75.79944 ° W  / 20.02083 ; - 75.79944 Coordin...",Coordinates : 22 ° 00 ′ N 80 ° 00 ′ W  /  22.000 ° N 80.000 ° W  / 22.000 ; - 80.000,,-453840009279473504
when did michigan last win a national championship,1989,2012,0,0.0,True,False,4.0,['Gold retrieved but not passed to generator'],"Michigan -- Ohio State football rivalry Michigan Wolverines Ohio State Buckeyes First meeting October 16 , 1897 Michigan 36 , Ohio State 0 Latest meeting November 25 , 2017 Ohio State 31 Michigan 20 Next meeting November 24 , 2018 Statistics Meetings total 114 All - time series Michigan leads , 58 -...","Michigan Wolverines men 's basketball 2018 -- 19 Michigan Wolverines men 's basketball team University University of Michigan First season 1909 All - time record 1,474 -- 1,034 (. 588 ) Head coach John Beilein ( 12th season ) Conference Big Ten Location Ann Arbor , Michigan Arena Crisler Center ( Ca...",,-4628267852301989966
this poster was created to increase support for the war effort.the poster links food rationing to,aiding the war effort,British public,0,0.0,True,False,2.0,['Gold retrieved but not passed to generator'],"Keep Calm and Carry On was a motivational poster produced by the British government in 1939 in preparation for World War II . The poster was intended to raise the morale of the British public , threatened with widely predicted mass air attacks on major cities . Although 2.45 million copies were prin...","Victory gardens , also called war gardens or food gardens for defense , were vegetable , fruit , and herb gardens planted at private residences and public parks in the United States , United Kingdom , Canada , Australia and Germany during World War I and World War II . George Washington Carver wrote...",,-5677793720723651646
who played taylor on the bold and beautiful,Hunter Tylo ( 1990 -- ) Sherilyn Wolter ( 1990 ),Hunter Tylo,0,0.5,True,True,1.0,['Answer span mismatch'],"Taylor Hayes Hunter Tylo as Taylor Hayes The Bold and the Beautiful character Portrayed by Hunter Tylo ( 1990 -- ) Sherilyn Wolter ( 1990 ) Duration 1990 -- 2002 2004 -- 14 2018 -- First appearance June 6 , 1990 ( 1990 - 06 - 06 ) Introduced by William J. Bell ( 1990 ) Bradley Bell ( 2004 ) Book app...","Taylor Hayes Hunter Tylo as Taylor Hayes The Bold and the Beautiful character Portrayed by Hunter Tylo ( 1990 -- ) Sherilyn Wolter ( 1990 ) Duration 1990 -- 2002 2004 -- 14 2018 -- First appearance June 6 , 1990 ( 1990 - 06 - 06 ) Introduced by William J. Bell ( 1990 ) Bradley Bell ( 2004 ) Book app...",,9140154657058392803
when was the time the eagles won the superbowl,2017,2007,0,0.0,True,True,1.0,"['Answer span mismatch', 'Hallucination']","Philadelphia Eagles Current season Established July 8 , 1933 ; 84 years ago ( July 8 , 1933 ) First season : 1933 Play in Lincoln Financial Field Philadelphia , Pennsylvania Headquartered in the NovaCare Complex Philadelphia , Pennsylvania Logo Wordmark League / conference affiliations National Foot...","Philadelphia Eagles Current season Established July 8 , 1933 ; 84 years ago ( July 8 , 1933 ) First season : 1933 Play in Lincoln Financial Field Philadelphia , Pennsylvania Headquartered in the NovaCare Complex Philadelphia , Pennsylvania Logo Wordmark League / conference affiliations National Foot...",,7217548419303343001
is jaffa cakes a biscuit or a cake,Cake,biscuit,0,0.0,True,True,1.0,"['Answer span mismatch', 'Hallucination']","Jaffa Cakes A Jaffa Cake cut in half Alternative names Jaffa Type Cake Place of origin United Kingdom Region or state All Regions Created by McVitie and Price Main ingredients Sponge cake , orange - flavoured jam , chocolate Variations Various limited edition flavours ( Lemon and lime , strawberry ,...","Jaffa Cakes A Jaffa Cake cut in half Alternative names Jaffa Type Cake Place of origin United Kingdom Region or state All Regions Created by McVitie and Price Main ingredients Sponge cake , orange - flavoured jam , chocolate Variations Various limited edition flavours ( Lemon and lime , strawberry ,...",,8239463385147663167
how long was dark side of the moon number 1,42 : 49,3,0,0.0,True,True,1.0,"['Answer span mismatch', 'Hallucination']","The Dark Side of the Moon Album cover by Hipgnosis and George Hardie Studio album by Pink Floyd Released 1 March 1973 ( 1973 - 03 - 01 ) Recorded 1 June 1972 -- January 1973 Studio Abbey Road Studios , London Genre Progressive rock Length 42 : 49 Label Harvest Producer Pink Floyd Pink Floyd chronolo...","The Dark Side of the Moon Album cover by Hipgnosis and George Hardie Studio album by Pink Floyd Released 1 March 1973 ( 1973 - 03 - 01 ) Recorded 1 June 1972 -- January 1973 Studio Abbey Road Studios , London Genre Progressive rock Length 42 : 49 Label Harvest Producer Pink Floyd Pink Floyd chronolo...",,-251770629620567718
where can the mona lisa be found today,"Musée du Louvre , Paris",Musée du Louvre,0,0.8571428571428571,True,True,1.0,['Other / partial match'],"Mona Lisa Italian : La Gioconda , French : La Joconde Artist Leonardo da Vinci Year c. 1503 -- 06 , perhaps continuing until c. 1517 Medium Oil on poplar panel Subject Lisa Gherardini 77 cm × 53 cm ( 30 in × 21 in ) Location Musée du Louvre , Paris","Mona Lisa Italian : La Gioconda , French : La Joconde Artist Leonardo da Vinci Year c. 1503 -- 06 , perhaps continuing until c. 1517 Medium Oil on poplar panel Subject Lisa Gherardini 77 cm × 53 cm ( 30 in × 21 in ) Location Musée du Louvre , Paris",,-4733919216436438252
where did the california gold rush take place,Sierra Nevada and Northern California,Sierra Nevada and Northern California goldfields,0,0.9090909090909091,True,True,1.0,['Other / partial match'],"California Gold Rush Prospectors working California gold placer deposits in 1850 Date January 24 , 1848 ( 1848 - 01 - 24 ) -- 1855 Location Sierra Nevada and Northern California goldfields Coordinates 38 ° 48 ′ 09 '' N 120 ° 53 ′ 41 '' W  /  38.80250 ° N 120.89472 ° W  / 38.80250 ; - 120.89472 Co...","California Gold Rush Prospectors working California gold placer deposits in 1850 Date January 24 , 1848 ( 1848 - 01 - 24 ) -- 1855 Location Sierra Nevada and Northern California goldfields Coordinates 38 ° 48 ′ 09 '' N 120 ° 53 ′ 41 '' W  /  38.80250 ° N 120.89472 ° W  / 38.80250 ; - 120.89472 Co...",,-5332490337340067440