python - Removing duplicates in pandas data frame if one column differs, but is in a given list -


i have dataframe duplicate entries coming 2 sources, values should unique, 1 column not formatted same, hence should remove duplicate different names in 1 column, if names within list.

technically, remove row in pandas dataframe if there exist row same a , b values, if row’s z value 'bar' , other’s 'z' 'foo'.

an example might clearer:

i have given dataframe df

     b     z  'a'   'a'   'foo' 'a'   'a'   'bar' 'b'   'a'   'bar' 'c'   'c'   'foo' 'd'   'd'   'blb'

and get

     b     z  'a'   'a'   'foo' 'b'   'a'   'bar' 'c'   'c'   'foo' 'd'   'd'   'blb'

note that:

  • the rows other values 'foo' , 'bar' in z column should not touched.
  • it’s not important if 'foo' , 'bar' stay same because changed same value afterwards.
  • it great generalize duo 'foo' , 'bar' list.

attempts far: here best guess, doesn’t work though… don’t understand groupby returns. i’m sure there magical pandas one-liner can’t find.

new_df = [] row in df.groupby('a'):     if rowloc['z'].isin('foo'):          if not row['z'].isin('bar'):                     new_df.append(row)

thanks !

i think can expected result concatenating 2 subsets of original dataframe:

  • one z values neither foo nor bar
  • and other 1 duplicates according a , b dropped

here's example gives me expected output:

data = """     b     z     foo     bar b     bar c   c   foo d   d   blb""" df = pd.read_csv(stringio(data),sep='\s+')  ls = ['foo','bar'] df1 = pd.concat((df.loc[~(df.z.isin(ls))], # no foos or bars here                  df.loc[  df.z.isin(ls)].drop_duplicates(subset=['a','b'])                  )).sort_index()

an simpler option might replace foo bar everywhere in z , drop duplicates:

df1 = df.replace({'z':{'foo':'bar'}}).drop_duplicates()

you replace both foo , bar other value you're going use:

df1 = df.replace({'z':{'foo':'xyz', 'bar':'xyz'}}).drop_duplicates()

Comments

Post a Comment

Popular posts from this blog

'hasOwnProperty' in javascript -

i use obj.hasownproperty judge whether object has property, when replaced obj[prop] !== undefined , not normal implementation, ask, why behind method can not use it? object.hasownproperty(prop); object[prop] !== undefined; obj[prop] !== undefined wrong 2 reasons: you can explicitly set property undefined , obj[prop] = undefined; . obj.hasownproperty(prop) return true in case. obj[prop] follow prototype chain, return property that's inherited. obj.hasownproperty(prop) returns true if property exists directly in object, returns false inherited properties.
Read more

How to understand 2 main() functions after using uftrace to profile the C++ program? -

i trying uftrace profile following simple c++ program: #include <iostream> class { public: a() {std::cout << "a created" << std::endl;} ~a() {std::cout << "a destroyed" << std::endl;} }; int main() { a; return 0; } the profile result this: # uftrace a.out created destroyed # duration tid function 2.026 [ 4828] | __cxa_atexit(); [ 4828] | main() { [ 4828] | __static_initialization_and_destruction_0() { 89.397 [ 4828] | std::ios_base::init::init(); 0.768 [ 4828] | __cxa_atexit(); 93.029 [ 4828] | } /* __static_initialization_and_destruction_0 */ 94.425 [ 4828] | } /* main */ [ 4828] | main() { [ 4828] | a::a() { 11.104 [ 4828] | std::operator <<(); 10.825 [ 4828] | std::basic_ostream::operator <<(); 24.514 [ 4828] | } /* a::a */ [ 4828] | a::~a() { 0.978 [ 4828] | ...
Read more

android - Unable to generate FCM token from dynamically instantiated Firebase -

our business logic requires instantiate firebase during runtime. fetch firebase credentials (app id, api key etc.) default firebase location after knowing user's public key , create firebase instance using credentials. this means there 2 firebase instances used within app: the default "index" firebase gives credentials second the actual firebase intend use point forward the second firebase initialised this: firebaseapp app = firebaseapp.initializeapp(<context>, <options>, <app_label>); our problem traditional method of retrieving fcm token using firebaseinstanceidservice , ontokenrefresh() fails since ontokenrefresh() method called first firebase instance. directly calling string token = firebaseinstanceid.getinstance(app).gettoken(); returns null never ready when called. have tried polling test if token generated @ point. no luck. how can generate fcm token reliably firebase instance instantiated during runtime? i...
Read more