Upload 2 files

message.csv

@@ -0,0 +1,100 @@
+id,message,original,genre
+2,Weather update - a cold front from Cuba that could pass over Haiti,Un front froid se retrouve sur Cuba ce matin. Il pourrait traverser Haiti demain. Des averses de pluie isolee sont encore prevues sur notre region ce soi,direct
+7,Is the Hurricane over or is it not over,Cyclone nan fini osinon li pa fini,direct
+8,Looking for someone but no name,"Patnm, di Maryani relem pou li banm nouvel li ak timoun yo. Mesi se john jean depi Monben kwochi.",direct
+9,UN reports Leogane 80-90 destroyed. Only Hospital St. Croix functioning. Needs supplies desperately.,UN reports Leogane 80-90 destroyed. Only Hospital St. Croix functioning. Needs supplies desperately.,direct
+12,"says: west side of Haiti, rest of the country today and tonight",facade ouest d Haiti et le reste du pays aujourd hui et ce soir,direct
+14,Information about the National Palace-,Informtion au nivaux palais nationl,direct
+15,Storm at sacred heart of jesus,Cyclone Coeur sacr de jesus,direct
+16,"Please, we need tents and water. We are in Silo, Thank you!",Tanpri nou bezwen tant avek dlo nou zon silo mesi.,direct
+17,"I would like to receive the messages, thank you",Mwen ta renmen jouin messag yo. Merci,direct
+18,I am in Croix-des-Bouquets. We have health issues. They ( workers ) are in Santo 15. ( an area in Croix-des-Bouquets ),"Nou kwadebouke, nou gen pwoblem sant m yo nan santo 15",direct
+20,"There's nothing to eat and water, we starving and thirsty.",Bon repo pa gen anyen menm grangou swaf,direct
+21,I am in Petionville. I need more information regarding 4636,M nan pv mvle plis enfomasyon sou 4636,direct
+22,"I am in Thomassin number 32, in the area named Pyron. I would like to have some water. Thank God we are fine, but we desperately need water. Thanks",Mwen thomassin 32 nan pyron mwen ta renmen jwen yon ti dlo gras a dieu bo lakay mwen anfom se sel dlo nou bezwen,direct
+24,"Let's do it together, need food in Delma 75, in didine area",Ann fel ansanm bezwen manje nan delma 75 nan riyel didine,direct
+25,More information on the 4636 number in order for me to participate. ( To see if I can use it ),gen plis enfomasyon sou 4636 la pom w sim ap ka patisipe.,direct
+26,"A Comitee in Delmas 19, Rue ( street ) Janvier, Impasse Charite #2. We have about 500 people in a temporary shelter and we are in dire need of Water, Food, Medications, Tents and Clothes. Please stop by and see us.","Komite katye delma 19 rue janvier imp charite no 2. Nou genyen 500 moun ki nan abri pwovizwa. Nou bezwen dlo, manje, medikaman, tant, vtman. Tanpri vizite n.",direct
+27,We need food and water in Klecin 12. We are dying of hunger. Impasse Chretien Klecin 12 extended ( extension ) We are hungry and sick.,Nou bezwen mange avek dlo nan klcin 12 LA LAFIN AP TU NOU IMPASSE chrtien klcin 12 pwolonge nou gwangou nou malad,direct
+28,are you going to call me or do you want me to call ou? let me know?,Eske se rele nap relem oubyen se mwen kap rele nou?si se mwen eske,direct
+30,I don't understand how to use this thing 4636.,Mwen pa konprann koman pou m itilize bagay 4636 la,direct
+31,I would like to know if the earthquake is over. Thanks,Mwen ta remen connin si trenblem de terre afini oke,direct
+32,I would like to know if one of the radio ginen Journalist died?,Mwen ta renmen konnen eske ge jounalis radyo ginen ki mouri.,direct
+33,"I'm in Laplaine, I am a victim",Mwen laplan mwen viktim kot yap bay d pou latranbl,direct
+34,"There's a lack of water in Moleya, please informed them for me.",Nan moleya pa gen dlo svp f konnen sa pou mwen.,direct
+35,Those people who live at Sibert need food they are hungry.,nou menm nan sibert nou grangou nou bezwen mange,direct
+36,"I want to say hello, my message is to let you know that there's an area in faustin Anhy street that has nothing neither food, water and medicine,",Mwen salye nou dab mesaj mwen an se jis nou gen yen faustin 1re rue anhy 1re kipa jwenn an yen ni vizit ni dlo e moun yo dan le bezyon yap achte ti sa,direct
+37,Can you tell me about this service,Can you tell me about this service,direct
+38,"People I'm at Delma 2, we don't anything what so ever, please provide us with some food, water, and medicine",MEZANMI MWEN MWEN NAN DELMA 2 NOU TR MAN MAL NOU PA JAN M JWEN ANY,direct
+39,"We are at Gressier we needs assistance right away. ASAP, Come help us.",Se gressier nou an difikilte tanpri vin ede nou,direct
+41,How can we get water and food in Fontamara 43 cite Tinante?,Comment nou ka jwen dlo ak manje nan font 43 cite tinante,direct
+42,We need help. Carrefour has been forgotten completely. The foul odor is killing us. Just letting you know. Thanks!!,Nap di secours yo bliye kafou net sant m ap touye moun fe mesage la pase ok mersi.,direct
+43,"Good evening, Radio one please. I would like information on Tiyous.",Bonswa radio one svp eskew pap k enfomasyon sou tiyous.,direct
+44,"We have a lot of problem at Delma 75 Avenue Albert Jode, those people need water and food.",We have a many probleme a baout delmas 75 aveny albert jode the pepole need some weater some food and medcin Iwat my name rejinald,direct
+45,"I'm here, I didn't find the person that I needed to send the pant by phone",Mwen la moun poum te voye pantalon mwen pa jwenn yo pa telefon,direct
+46,People have been sleeping outdoors in a field near Lilavois since 12 Jan. No coords on Lilavois but apparently it is near PaP,ofit des habitants qui dorment a la belle etoile sur le terrain de Lilavois depuis le 12 janvier.,direct
+47,"We want you to know that Carrefour need help, we starving to death.",koufou poko jwenn ankenn ed nap mouri grangou men nou gen dlo ok.,direct
+48,"How we can find food and water? we have people in many differents needs, and also for medicine at Fontamara 43 cite Tinante.",Comment nou ka jwen dlo ak manje nou gen moun ki gen tout kalte pwoblem nan fontamara 43 cite tinante,direct
+49,"Delmas 33 in Silo, need water.",Delma 33 silo gen problem dlo,direct
+50,I would like to get help at Cote Plage in Carrefour,Mwen ta renmen yo vizite cote plage carrefour,direct
+51,"I am in Leoganes, where can I get food? Please",mwen leyogan ki kote ki gen manje tanpri,direct
+52,"The Comite Miracle in the area of Alerte Rue Monseigneur Guilloux, ( Streets, Alerte and the cross street is Mgr Guilloux ) would like to urgently receive food, water and tents for the people in that area. Thanks",komite mirak ki tabli nan zone alerte mgr guilloux ta renmen resevwa prese prese dlo manje ak tant pou moun nan zone nan,direct
+53,"People from Dal blocked since Wednesday in Carrefour, we having water shortage, food and medical assistance.",moun sou dal blok fo mekredi nan kfou fy gen pwoblem dlo manje remed,direct
+54,"In Jacmel it's not working at all, because people are dying of hunger.",n jakmel sa pa mache ditou paske moun yo ap mouri grangou,direct
+56,We have no one everybody is dead.,nou a gen peson tout moun mouri,direct
+57,"We don't talk about Petit-Goave, Please, look into Petit-Goave.",Nou pa janm pale de tigwav otorite yo voye je nou sou tigwav se chausler st jean.,direct
+58,"Good evening, is the earthquake end?",Bonswa eske tanbleman te fini,direct
+60,"People in Fontamara 27 in impass area Pierre Louis having lots of difficulties, please help, ASAP.",moun fontamara 27 zon impass pierre louis nan problem. sos.,direct
+61,"Good evening, I congratulate you for all the good work and with strenght i'm listening from Matisan 1, we have water and food shortage but God provided his grace upon us.",Bonswa mwen felisite nou pou bon travay sa malgre tou kouraj map kouten matisan 1 nou gen problem mange ak dlo men bondye te fe nou gras,direct
+62,how can we find aid and food in fontamara ( carrefour ),Koman nou ka jwenn sekou ak manje nan fontamara 43 ru menos cite la bel,direct
+63,"Am listening to radio in Jacmel. Need help to remove dead bodies at Colege la Trinite-universite, the bodies are the professors and students","Mwen ap koute radyo wa jakmel map pou vini ede nou retire kadav anba dekonb kolj La trinite ki te loje inivsite inasmo, kadav yo se etidyan ak pwofes t",direct
+64,People from Jacmel are requesting a tractor in that area because there is a civil unrest and social disturbance in that area.,"MOUN JACMEL YO MANDE POU ENSTANS KONSENE YO VOYE YON TRAKTER NAN WOUT JACMEL LA, PASKE GEN ANPIL DEZOD SOU SA A ( MARCELIN JEAN DEPI JACMEL )",direct
+65,Im asking a general prayer for the country of Haiti.,MWEN MANDE YON JEN NASYONAL POU PEYI A,direct
+66,"We are at KF Marotiere 85, we have food and water shortage, please send food for us.",Nou nan kf maroty 85 nou pa gen dlo val anvayi nou voye manje manje pou nou tanpri bay mesaj la,direct
+67,I'm listening to you at Miraguan we asking the government to take change because one gallon gas is 80.,MWEN AP KOUTE NOU MIRAGWAN NOU AP MANDE POU RESPONSAB YO PRAN YON DESIZYON NAN MOMAN NOU YE LA A GALON GAZOLINE AP VANN 8O DOLA.,direct
+68,What's up? I would like to know how the Arab is doing.,Sak pase mwen ta renmen konnen kijan arab la ye,direct
+70,I am listening to radio wa in jacmel. I am asking for help to remove the dead bodies under La trinite college situated at university inasmo. The dead bodies are those of students and teachers,"Mwen ap koute radyo wa jakmel map mande pou vini ede nou retire kadav anba dekonb kolj La trinite ki te loje inivsite inasmo, kadav yo se etidyan ak pwo",direct
+71,In which transfert house does someone abroad has to go to send money to haiti,nan Ki mezon transf yon moun ki a letranje ka itilise pou voye lajan pou yon fanmi li ki an ayiti?,direct
+73,"For your information, There are people that are found in the rubbles of the School of Trinite, ( L'Ecole Sainte Trinite ) in Jacmel. Cookies brought to them by Colombian dogs are keeping them alive.","Pou infomasyon juska pwesent genyen moun yo touve aba decon nen lekol latrinite nan jakmel, se chien colombien ki pote bonbon nan bouche yo bay moun sa yo",direct
+74,When can we get some help in Jacmel?,Kil nou ka jwenn asistans nan jakml,direct
+78,How can we find help and food in fontamara 43 rue menos,Koman nou ka jwenn sekou ak manje nan fontamara 43 ru menos nan tet la bel,direct
+79,"SOS SOS, please provide police officers on the streets as they are very insecure",EMGENCY EMGENCY SI POLIS LA TE KA BAY PREZANS LI SOU CHAK PLAS AK LARI LI TAP BON PASKE CHAK SWA YO F ANPIL DEGA MENM DETWI LAVI MOUN ENPOTAN,direct
+80,.. .. . we are here our mother has no more water. if you are there let us know ( location not provided ),MLT KK LWE ESKE NOU LA MANMAN NOU PAGEN DLO ANK SILA FL KON,direct
+81,People needing water with baby Location : Beach 24,Gen ampil pwoblem nan kot plaj 24 nou ta renmen jwen dlo gen ti bebe kap soufri nou gen 3 jou konsa,direct
+82,"help is needed in fond parisien, no idea where that is, but any haitian can tell you",san panse pou fonparisyen vin kapital peyia?gerbens,direct
+83,"We're asking for water, medical supply, food","Nap mande tout ganizasyon kap bay d yo, nan kwadbouk pli presizeman nan lokalite nwal, ki pa gen dlo, mange, medikamen depi li seys la pase a.",direct
+84,"My home is at Gressier, it has almost collapsed. I would like to distroy it before it collapses completly.",Kay mwen nan gresi pri tomb mwen ta renmen metel ati avan l tomb,direct
+85,would like to know where food and water are being distributed. ( location not provided ),Mwen ta renmen konnen ki kote nou ka jwenn yon ti dlo moun ka bw ak yon ti ed manje pou yon group moun ki grangou. Mesi,direct
+86,"i am very happy, i hear god, religious hyme",Mwen tre kontan li mwen tande bondye fe ou la mwen ap diw demi deyi anba pwela pou seren leswa,direct
+88,We are seven in the house. Located betwenn Musso and Juvenat. Dyobel-Dyobal. .. not sure The rest of the information is not clear.,"Mwen salye nou pou sipo n ak solidarite nap bay pap ayiswen an jodi a. M abite nan yon tizo n ki rele dyobl ant miso ak jivna 7 andan net, koman pou n",direct
+90,He is a pastor and an interpreter seeking to help response teams.,I am an interpreter I am really to give my help. So today I was at the airport but I am sorry because there was no way. My name is Gerard Derice. I am pastor.,direct
+91,we have problem at Paco Lazon this is General Police Department we want you to know we almost out of food and water.,Nou gen pwoblem nan paco la zon Direksyon General Police sove nou paske mange ak dlo nou ap fini et nou bezwen lot swen sante secours SVP!,direct
+92,We are in Sainte Bernadette. There are 2 areas that have not received anything. We are buying water ( warm ) for 5 gourdes.,nou nan st banadt nan fem nou se2 kote ki pako jwenn anyen nap ht 1sache dlo cho pr 5g andanw,direct
+94,I would like to communicate with my family I don I t have any minutes on my cell phone please help,"Mwen ta renmen kominike ak fanmi mwen, men mwen pagen kat sou telefon mwen",direct
+95,some people are sleeping outside on a field at Lilavois 50 and are dying of hunger since January 12th.,fit des habitants qui dorment a la belle etoile sur le terrain de Lilavois 50 et qui meurent de faim depuis le 12 janvier.,direct
+96,Friend I dont know what is going on with you for I hear of what is going on but i have not hear any news about you. I hear what happen Carrefour and petion-Ville,"Kamarad, mwen pa konn sak pase ou menn. paske mwen pa pran nouvel ou. Mwen tande sak pase Kafou, Delma ak Petyon Vil. Mwen pa konn si lot kamarad yo vik",direct
+97,"i'm asking for help to this valley especially Santo, Sath, B","MWEN MANDE POU D YO RIVE NAN PLENN NAN TOU SI TOU NAN SANTO, SATH, B",direct
+99,"I am a driver, a mechanic ,. I want to help","MWEN SE YON NMALIEN, CHOF, MEKANISYEN MWEN BEZWEN BAY SEKOU",direct
+100,a lot and we don't have any news of him. We haven't even found a body so we could at least know he is dead. The hospitals need to be checked and the registry books also. Please help us!! ( This seems to be the end of another message ),"anpil E nou pa gen oken nouvel li, menm ke a nou pa jwenn o mwen nou ta di li mouri. F yo verifye nan lopital yo, sitou nan kaye rejis yo. Mesi. Ede n svp",direct
+101,"We have a big problem in Jacmel, we left Port-au-Prince without food, clothes and money. we are really in a critical situation.","Nou gen gwo pwoblem nan jakmel, espesyalman nan kok chant paske nou siti potopwens san rad, san manje, san kob. nou vrman nan yon siyasyon tre kritik. nou ta",direct
+102,We would like to receive some help in the Section Communale. There is a lot of violence.,renmen pou yo ta fe yon bagay pou nou nan seksyon kominal yo. se te Bichet depi kek chant.,direct
+103,I would like to know how food is distributed.,J aimerais savoir les piste de distribution.,direct
+105,I can play carnaval Anbasad Camp there I think this is a simple comment about a creole rap group - Anbasad Camp. Does not refer to location or read as a cry for help. TK,M ka jwen kanaval anbasad camp lan,direct
+106,A cold front is found over Cuba this morning. It could cross Haiti tomorrow. Isolated rain showers are expected over our region tonight.,Un front froid se retrouve sur Cuba ce matin. Il pourrait traverser Haiti demain. Des averses de pluie isolee sont encore prevues sur notre region ce soi,direct
+107,ples give us cell cards ( cell phone minuts ) we cannot find cell phone cards to buy,Vou kat pou mwen mesi davance digi pake nou pa ka jenn kat achete.,direct
+108,Whoever sees her in the streets : she was wearing a white denim skirt and a printed black t-shirt and her hair is in a cornrow do.,AL NENPOT MOUN KI WEL NAN LARI MEN KI KOULE RAD KI SOULI JIP DINN BLANK PASE SOU KOTE JIP LA youn mayo nwa souli ekriti blank pase devan l li penyen tiko,direct
+110,"Please we need help, food and toiletries.",KI KRAZE. TAMPRI NOU BEZWEN ED MANJE AK ATIK POU TWALFT ELATRYE. D,direct
+111,A weather forcast. . of a cold front in cuba and could pass through haiti by night..,Un front froid se retrouve sur Cuba ce matin. Il pourrait traverser Haiti demain. Des averses de pluie isolee sont encore prevues sur notre region ce soi,direct
+112,"food water mediacation, we dont have tents to protect our selves, i am using my cistern. lovation not provided","e, dlo, medikaman, n pa gen tant pou protegenn kont soley ak lapli. Genyen anpil lot fanmi ki afekte m pa konnen effectif la vrman. tanpri si n resevwa me",direct
+113,good people help us. god bless you and us too,saj sa ede nou. God bless you and us too.,direct
+114,"The ADJS group house in Jacmel. They are talking with people in the southeast. There are a lot of victims and people suffering, especially in Jacmel. Something about an entire house collapsing. The road sot pop in Jacmel is cut off.","Gwoup, AJDS kay jakmel, pa dande nou pale d sides ditou, nou viktim anpil, sitou vil jakmel gaya pa ret kay ank kay jakmel rout sot pop, a jakmel la koupe",direct
+115,This is a request that the aid services not forget the south-east region because there are a lot of victims and people suffering there. A number is given.,nap mande poun pa bliye sides la paske nou viktim anpil. 6515O96,direct
+117,Where can people in Fort Mercredi can find food and water?,ki kote mounn fort mercredi ka jwenn dlo ak manje?,direct
+118,( im taking a guess at this sorry its a mix of creole and french. sms.) message as i understand. whos close to mounn fort mercredi  food and water is running low. because there is a problem with people hurt. please help us.,Ki kote mounn fort mercredi ka jwenn manje ak dlo. paske nou gen anpil pwoblem nan zonn nan. please ede nou.,direct
+119,We are at Fort Mercredi ( wednesday ) where can we find tents and treated water.,Nous sommes  Fort - Mercredi Ou on peux trouver des tentes et des eaux traites,direct
+120,whos next to fort mercredi i would like food and water please,KI KOTE MOUNN FORT MERCREDI KA JWENN DLO AK MANJE. PLEASE,direct
+121,The wounded in the Saint Michely hospital have no medicine. (This looks like part of a message that got cut off),"kiblese yo, nan lakou lopital saint michel yo pagen medikaman, yap m",direct
+122,"We are about 500 people. We're in Martissant 23, Village Dantes. God bless you.","onn effectif la pou zonn nan men nou ka anviron 500. Tanpri eden nou nan martisan 23, village dantes. God bless you and us.",direct
+123,"Digicel let me go through, it's an emergency",D. igicel kitem pase se yon urgeence,direct
+124,Where can I find Capital Bank please?,ki adres nou ka jwenn kapital bank silvouple,direct
+125,We are in Plaine du Cul-de-sac. Where's the nearest food distribution?,Nou laplan di kildesak ki ba yap bay dlo ak manje.,direct

usage.py

@@ -0,0 +1,13 @@
+from transformers import pipeline
+extractor = pipeline("text2text-generation", model=".")
+
+
+import pandas as pd
+df = pd.read_csv("message.csv")
+texts=df["message"]
+for intent in texts:
+
+  label=extractor(intent)[0]["generated_text"]
+  if label=="":
+               label="No message detected"
+  print (label )