python - Detect header delimiters importing a csv file using pandas read_csv -

-

here go again.

hi, i'm trying detect error in csv file.

the file should follows

    goodfile.csv      "col_a","col_b","col_c","col_d"     "row1cola","row1colb","row1colc","row1cold"     "row2cola","row2colb","row2colc","row2cold"     "row3cola","row3colb","row3colc","row3cold"     "row4cola","row4colb","row4colc","row4cold"     "row5cola","row5colb","row5colc","row5cold"     "row6cola","row6colb","row6colc","row6cold"     "row7cola","row7colb","row7colc","row7cold"

but file have actually

    brokenfile.csv      "col_a","col_b",col c,"col_d"     "row1cola","row1colb","row1colc","row1cold"     "row2cola","row2colb","row2colc","row2cold"     "row3cola","row3colb","row3colc","row3cold"     "row4cola","row4colb","row4colc","row4cold"     "row5cola","row5colb","row5colc","row5cold"     "row6cola","row6colb","row6colc","row6cold"     "row7cola","row7colb","row7colc","row7cold"

when import 2 files pandas

    data = pd.read_csv('goodfile.csv')     data = pd.read_csv('brokenfile.csv')

i same result

    data            col_a     col_b     col_c     col_d     0  row1cola  row1colb  row1colc  row1cold     1  row2cola  row2colb  row2colc  row2cold     2  row3cola  row3colb  row3colc  row3cold     3  row4cola  row4colb  row4colc  row4cold     4  row5cola  row5colb  row5colc  row5cold     5  row6cola  row6colb  row6colc  row6cold     6  row7cola  row7colb  row7colc  row7cold

anyway, want detect error in second file "brokenfile.csv" lacks "" between header col_c

i think can detect missing " in columns of dataframe str.contains , boolean indexing inverted boolean array ~:

import pandas pd import io  temp=u'''"col_a","col_b",col c,"col_d" "row1cola","row1colb","row1colc","row1cold" "row2cola","row2colb","row2colc","row2cold" "row3cola","row3colb","row3colc","row3cold" "row4cola","row4colb","row4colc","row4cold" "row5cola","row5colb","row5colc","row5cold" "row6cola","row6colb","row6colc","row6cold" "row7cola","row7colb","row7colc","row7cold"''' #after testing replace io.stringio(temp) filename df = pd.read_csv(io.stringio(temp), quoting = 3) print df       "col_a"     "col_b"       col c     "col_d" 0  "row1cola"  "row1colb"  "row1colc"  "row1cold" 1  "row2cola"  "row2colb"  "row2colc"  "row2cold" 2  "row3cola"  "row3colb"  "row3colc"  "row3cold" 3  "row4cola"  "row4colb"  "row4colc"  "row4cold" 4  "row5cola"  "row5colb"  "row5colc"  "row5cold" 5  "row6cola"  "row6colb"  "row6colc"  "row6cold" 6  "row7cola"  "row7colb"  "row7colc"  "row7cold"  print df.columns index([u'"col_a"', u'"col_b"', u'col c', u'"col_d"'], dtype='object')  print df.columns.str.contains('"') [ true  true false  true]  print ~df.columns.str.contains('"') [false false  true false]  print df.columns[~df.columns.str.contains('"')] index([u'col c'], dtype='object')

Comments

Post a Comment

Popular posts from this blog

javascript - How to get current YouTube IDs via iMacros? -

-
i want viewed youtube video id , save csv via imacros, gets nothing. here js code: var videoid; videoid ="code:"; videoid +="url goto=https://www.youtube.com/watch?v=dbnywxdz_pa"+"\n"; videoid +="add !extract {{!urlcurrent}}"+"\n"; videoid +="set !var1 eval(\"var s=\"{{!urlcurrent}}\"; s.match((?<=watch\\?v=|/videos/|embed\\/)[^#\\&\\?]*);s[0]; \")"+"\n"; videoid +="add !extract {{!var1}}"+"\n"; videoid +="saveas type=extract folder=* file=url.csv"+"\n"; try this: var videoid = "url goto=https://www.youtube.com/watch?v=dbnywxdz_pa" + "\n"; videoid += "set !extract {{!urlcurrent}}" + "\n"; videoid += 'set !extract eval("\'{{!extract}}\'.match(/v=(.{11})/)[1];")' + "\n"; videoid += "saveas type=extract folder=* file=url.csv" + "\n"; iimplay
Read more

c# - Maintaining a program folder in program files out of date? -

-
for program i'm writing in vs c# wpf need store user related information on user's computer. far knew has been done creating folder in c:\program files , adding whatever program related info folder in subfolders or whatever. after doing browsing came across lot of people saying method out of date because access may denied create folder there, works administrative accounts, etc.. 1 site suggested saving c:\users\username\appdata\roaming or c:\users\username\appdata\local. question best , date method saving program data users computer? also take @ msdn article . it uwp apps have general idea put if developing wpf app. you may need these folders: environment.specialfolder.applicationdata environment.specialfolder.localapplicationdata environment.specialfolder.commonapplicationdata
Read more

emulation - Android map show my location didn't work -

-
i have been struggle current location in google map, tried official map demo, not working also. shows getmylocation button on upper right, didn't show blue dot on map current location. here code , i'm using emulator target api 23, guess may emulator's problem since code download directly github. advice appreciated. [screenshot][1] package com.example.mapdemo; import com.google.android.gms.maps.googlemap; import com.google.android.gms.maps.googlemap.onmylocationbuttonclicklistener; import com.google.android.gms.maps.onmapreadycallback; import com.google.android.gms.maps.supportmapfragment; import android.manifest; import android.content.pm.packagemanager; import android.os.bundle; import android.support.annotation.nonnull; import android.support.v4.app.activitycompat; import android.support.v4.content.contextcompat; import android.support.v7.app.appcompatactivity; import android.widget.toast; /** * demo
Read more