Hi professor,

which will use Bash plus Shell tools, to clean the data. cantril_data_cleaning expects three .tsv file ----------but the data given one of the file is .csv.

are we supposed to convert it?

ANONYMOUS wrote:

Hi professor,

which will use Bash plus Shell tools, to clean the data. cantril_data_cleaning expects three .tsv file ----------but the data given one of the file is .csv.

are we supposed to convert it?

Hi, That was a mistake on my part. Now fixed. Long story short, a csv file would be an error as it cannot be interpreted as a .tsv file.

Cheers MichaelW

Ops, that's sad coz I just accomplished the file format conversion in my script last night.🥲

"Zexu Ding" [email protected] wrote:

Ops, that's sad coz I just accomplished the file format conversion in my script last night.🥲

Hi Zexu, I am impressed. It's actually not trivial as .csv data can have commas in the strings, and also hidden . Was your solution able to cope with these?

Cheers MichaelW 👨‍🎨

Yes, I've seen that point. I took a lot of effort to craft a regex to ignore the comma within the quoted fields.

And I'm surprised how challenging it could be, for those CS beginners, but also interesting.