apache spark - Read JSON with odd format -


i testing skills easy data. apparently data comes serious challenge, data comes in property called data in array of arrays, not in array of jsons. troublesome because examples spark's json support i've found require data comes in series of jsons.

{ ...      "data" : [ [ 1, "5dc7f285-052b-4739-8dc3-62827014a4cd", 1, 1425450997, "714909", 1425450997, "714909", "{\n}", "2013", "gavin", "st lawrence", "m", "9" ]               , [ 2, "17c0d0ed-0b12-477b-8a23-1ed2c49ab8af", 2, 1425450997, "714909", 1425450997, "714909", "{\n}", "2013", "levi", "st lawrence", "m", "9" ]               , [ 3, "53e20da8-8384-4ec1-a9c4-071ec2ada701", 3, 1425450997, "714909", 1425450997, "714909", "{\n}", "2013", "logan", "new york", "m", "44" ]               , [ 4, "8d47e747-e5c7-4413-b362-509a2fab3c9b", 4, 1425450997, "714909", 1425450997, "714909", "{\n}", "2013", "hudson", "new york", "m", "49" ] ... ]   ... }

i'd know if it's possible read json using sqlcontext.read.json in order obtain formatted data.


Comments

Post a Comment

Popular posts from this blog

'hasOwnProperty' in javascript -

i use obj.hasownproperty judge whether object has property, when replaced obj[prop] !== undefined , not normal implementation, ask, why behind method can not use it? object.hasownproperty(prop); object[prop] !== undefined; obj[prop] !== undefined wrong 2 reasons: you can explicitly set property undefined , obj[prop] = undefined; . obj.hasownproperty(prop) return true in case. obj[prop] follow prototype chain, return property that's inherited. obj.hasownproperty(prop) returns true if property exists directly in object, returns false inherited properties.
Read more

python - ValueError: No axis named 1 for object type <class 'pandas.core.series.Series'> -

i´m new programming. i´m trying use scipy minimize, had several issues , gotten through of them. right code, i'm not understanding why i´m getting error. par_opt = so.minimize(fun=fun_obj, x0=par_ini, method='nelder-mead', args=[series_pt_cal, dt, series_caudal_cal]) not enough info given op, somewhere in code it's specified operate data frame column (axis=1) on object pandas series. if code typically works occasional gives errors, check degenerative cases data frame may have 1 row. pandas has nasty habit of guessing want -- may decide reduce 1-row data frame series (e.g., apply() function; can disable using reduce=false in there). add line of code check object isinstance(df, pd.dataframe) or else convert offending pandas series data frame, s.to_frame().t problems had deal with.
Read more

java - How to provide dependency injections in Eclipse RCP 3.x? -

everyone! i'm trying deal eclipse rcp 3.x application. i've read lot of articles dependency injection in rcp e4 applications. can use di in rcp 3.x apps? i found perfect link di in e4. idea how use in rcp 3.x app? first of all, i'm interested in own objects injection (btw, how add own object application context?). best regards in 3.x code can ieclipsecontext necessary use contextinjectionfactory using ieclipsecontext workbenchcontext = platformui.getworkbench().getservice(ieclipsecontext.class); to workbench context. in view or editor can current part context using: ieclipsecontext partcontext = getsite().getservice(ieclipsecontext.class);
Read more