regex - Python: UserWarning: This pattern has match groups. To actually get the groups, use str.extract -


i have dataframe , try string, on of column contain string df looks like

member_id,event_path,event_time,event_duration 30595,"2016-03-30 12:27:33",yandex.ru/,1 30595,"2016-03-30 12:31:42",yandex.ru/,0 30595,"2016-03-30 12:31:43",yandex.ru/search/?lr=10738&msid=22901.25826.1459330364.89548&text=%d1%84%d0%b8%d0%bb%d1%8c%d0%bc%d1%8b+%d0%be%d0%bd%d0%bb%d0%b0%d0%b9%d0%bd&suggest_reqid=168542624144922467267026838391360&csg=3381%2c3938%2c2%2c3%2c1%2c0%2c0,0 30595,"2016-03-30 12:31:44",yandex.ru/search/?lr=10738&msid=22901.25826.1459330364.89548&text=%d1%84%d0%b8%d0%bb%d1%8c%d0%bc%d1%8b+%d0%be%d0%bd%d0%bb%d0%b0%d0%b9%d0%bd&suggest_reqid=168542624144922467267026838391360&csg=3381%2c3938%2c2%2c3%2c1%2c0%2c0,0 30595,"2016-03-30 12:31:45",yandex.ru/search/?lr=10738&msid=22901.25826.1459330364.89548&text=%d1%84%d0%b8%d0%bb%d1%8c%d0%bc%d1%8b+%d0%be%d0%bd%d0%bb%d0%b0%d0%b9%d0%bd&suggest_reqid=168542624144922467267026838391360&csg=3381%2c3938%2c2%2c3%2c1%2c0%2c0,0 30595,"2016-03-30 12:31:46",yandex.ru/search/?lr=10738&msid=22901.25826.1459330364.89548&text=%d1%84%d0%b8%d0%bb%d1%8c%d0%bc%d1%8b+%d0%be%d0%bd%d0%bb%d0%b0%d0%b9%d0%bd&suggest_reqid=168542624144922467267026838391360&csg=3381%2c3938%2c2%2c3%2c1%2c0%2c0,0 30595,"2016-03-30 12:31:49",kinogo.co/,1 30595,"2016-03-30 12:32:11",kinogo.co/melodramy/,0

and df urls

url 003\.ru\/[a-za-z0-9-_%$#?.:+=|()]+\/mobilnyj_telefon_bq_phoenix 003\.ru\/[a-za-z0-9-_%$#?.:+=|()]+\/mobilnyj_telefon_fly_ 003\.ru\/sonyxperia 003\.ru\/[a-za-z0-9-_%$#?.:+=|()]+\/mobilnye_telefony_smartfony 003\.ru\/[a-za-z0-9-_%$#?.:+=|()]+\/mobilnye_telefony_smartfony\/brands5d5bbr_23 1click\.ru\/sonyxperia 1click\.ru\/[a-za-z0-9-_%$#?.:+=|()]+\/chasy-motorola

i use 

urls = pd.read_csv('relevant_url1.csv', error_bad_lines=false) substr = urls.url.values.tolist() data = pd.read_csv('data_nts2.csv', error_bad_lines=false, chunksize=50000) result = pd.dataframe() i, df in enumerate(data):     res = df[df['event_time'].str.contains('|'.join(substr), regex=true)]

but return me

userwarning: pattern has match groups. groups, use str.extract.

how can fix that?

at least 1 of regex patterns in urls must use capturing group. str.contains returns true or false each row in df['event_time'] -- not make use of capturing group. thus, userwarning alerting regex uses capturing group match not used.

if wish remove userwarning find , remove capturing group regex pattern(s). not shown in regex patterns posted, must there in actual file. parentheses outside of character classes.

alternatively, suppress particular userwarning putting 

import warnings warnings.filterwarnings("ignore", 'this pattern has match groups')

before call str.contains.

here simple example demonstrates problem (and solution):

# import warnings # warnings.filterwarnings("ignore", 'this pattern has match groups') # uncomment suppress userwarning  import pandas pd  df = pd.dataframe({ 'event_time': ['gouda', 'stilton', 'gruyere']})  urls = pd.dataframe({'url': ['g(.*)']})   # capturing group, there userwarning # urls = pd.dataframe({'url': ['g.*']})   # without capturing group, there no userwarning. uncommenting line avoids userwarning.  substr = urls.url.values.tolist() df[df['event_time'].str.contains('|'.join(substr), regex=true)]

prints

  script.py:10: userwarning: pattern has match groups. groups, use str.extract.   df[df['event_time'].str.contains('|'.join(substr), regex=true)]

removing capturing group regex pattern:

urls = pd.dataframe({'url': ['g.*']})

avoids userwarning.


Comments

Post a Comment

Popular posts from this blog

How to understand 2 main() functions after using uftrace to profile the C++ program? -

i trying uftrace profile following simple c++ program: #include <iostream> class { public: a() {std::cout << "a created" << std::endl;} ~a() {std::cout << "a destroyed" << std::endl;} }; int main() { a; return 0; } the profile result this: # uftrace a.out created destroyed # duration tid function 2.026 [ 4828] | __cxa_atexit(); [ 4828] | main() { [ 4828] | __static_initialization_and_destruction_0() { 89.397 [ 4828] | std::ios_base::init::init(); 0.768 [ 4828] | __cxa_atexit(); 93.029 [ 4828] | } /* __static_initialization_and_destruction_0 */ 94.425 [ 4828] | } /* main */ [ 4828] | main() { [ 4828] | a::a() { 11.104 [ 4828] | std::operator <<(); 10.825 [ 4828] | std::basic_ostream::operator <<(); 24.514 [ 4828] | } /* a::a */ [ 4828] | a::~a() { 0.978 [ 4828] | ...
Read more

c# - Update a combobox from a presenter (MVP) -

i using mvp in project, new in mvp. have 2 comboboxes. when select option in combobox, combobox should filled new data. this action in presenter. view 'view1' in presenter, , introduced combobox1 , combobox2 properties in 'view1', because need 'datasource', 'displaymember', 'valuemember' , 'refresh()' in method below. but, when using pattern, enough send property like public string combobox2 { { return combobox1.selectedvalue.tosstring(); } } into presenter not whole combobox. how can solve problem? public void onselectedindexchangedcombobox1() { if (view1.combobox1.selectedindex == -1) { return; } datatable dt = tools.getdatatable("a path"); var query = (from o in dt.asenumerable() o.field<string>("afield") == farmerview.combobox1.selectedvalue.tostring() orderby o.field<string>("anotherfield") select...
Read more

How to put a lock and transaction on table using spring 4 or above using jdbcTemplate and annotations like @Transactional? -

i trying put lock on table while writing on table , if happened in between roll-back . trying convert below code lock table test_g1 read; lock table test_g write; -- begin; start transaction; insert test_g1 values(143); insert test_g values(145); select * test_g1; select * test_g; rollback; select * test_g; unlock tables; how convert above code @transactional spring jdbctemplate code? @transactional(rollbackfor={dataaccessexception.class}) public void test(){ jdbctemplate.execute("insert test1 (id, nam) values (4, 'a')"); throw new dataaccessexception("error") { }; } here trying throw error, insert statement should rollback it's not happening . thanks edit-1 attaching code , doing in jdbcdaoimpl.java , mentioned problem comment above test() . app.java package com.cgiri.javabrains.spring4; import org.springframework.beans.factory.annotation.autowired; import org.springframework.context.applic...
Read more