Python - How to import module from .so file from egg file without using an absolute file path -


i built pyahocorasick library python setup.py bdist_egg command , uploaded onto spark pyspark job.

however, .so file inside pyahocorasick can't imported through pkg_resources.resource_filename() method on spark cluster security reasons.

traceback (most recent call last):   file "spark_datawash.py", line 251, in <module>     import ahocorasick   file "build/bdist.linux-x86_64/egg/ahocorasick.py", line 7, in <module>   file "build/bdist.linux-x86_64/egg/ahocorasick.py", line 4, in __bootstrap__   file "build/bdist.linux-x86_64/egg/pkg_resources/__init__.py", line 1152, in resource_filename   file "build/bdist.linux-x86_64/egg/pkg_resources/__init__.py", line 1696, in get_resource_filename   file "build/bdist.linux-x86_64/egg/pkg_resources/__init__.py", line 1726, in _extract_resource   file "build/bdist.linux-x86_64/egg/pkg_resources/__init__.py", line 1219, in get_cache_path   file "build/bdist.linux-x86_64/egg/pkg_resources/__init__.py", line 1199, in extraction_error pkg_resources.extractionerror: can't extract file(s) egg cache  following error occurred while trying extract file(s) python egg cache:    [errno 13] permission denied: '/home/.python-eggs'  python egg cache directory set to:    /home/.python-eggs  perhaps account not have write access directory?  can change cache directory setting python_egg_cache environment variable point accessible directory.

this how pyahocorasick import .so:

def __bootstrap__():     global __bootstrap__, __loader__, __file__     import sys, pkg_resources, imp      __file__ = pkg_resources.resource_filename(__name__, 'ahocorasick.so')     __loader__ = none; del __bootstrap__, __loader__     imp.load_dynamic(__name__,__file__) __bootstrap__()

can import .so resource_stream() instead of resource_filename() or other way without need read absolute file path? all.

btw, can't install pyahocorasick on every node on spark cluster other reasons. have upload egg-zipped distribution later use.


Comments

Post a Comment

Popular posts from this blog

Command prompt result in label. Python 2.7 -

i want put result(output) of shell command label. command works, label shows "0", however, in command prompt, result shown correctly, need showed in label. doing ubuntu. myg1 = button(root, text="rodyti informacija", command=lambda: gauti()) myg1.pack(side=bottom) def gauti(): imti = tekstas.get("1.0", "end-1c") info = subprocess.call("id '{imti}' ".format(imti=imti), shell=true) w = label(root, text= info) w.pack(side = bottom) subprocess.call() returns exit code of process created (in case 0 success). if want text output of process, should instead call subprocess.check_output() .
Read more

javascript - How do I use URL parameters to change link href on page? -

i change href value of link using url parameters. example: default <a id="dlink" href="link-1">link</a> but, when user goes https://url.com/?dlink=link-2 it swaps out link new link <a id="dlink" href="link-2">link</a> first need value url. if you're not using javascript framework can create function using jquery. please check get url parameter jquery or how query string values in js it. after that, element "a" id , set value there. $("#dlink").attr("href", hreffromparam);
Read more

amazon web services - AWS Route53 Trying To Get Site To Resolve To www -

so have domain nameservers pointed aws route 53. site hosted on ec2 instance , reachable resolves site.com, if input www.site.com. i'm curious how site resolve www.site.com. have under route53 domains hosted zone 2 additional record sets outside of ns , soa: a site.com ec2 elastic ip cname www.site.com ec2 public dns i can reach site using both site.com , www.site.com, resolve site.com. there way make if enter either, resolves www.site.com? at first, both should record set. a site.com ec2 elastic ip www.site.com ec2 elastic ip and need redirect setting in web server (nginx, apache, ..) following. (source: how redirect www non-www nginx on centos 7 ) redirect non-www www if want redirect users plain, non-www domain www domain, add server block: server { server_name example.com; return 301 $scheme://www.example.com$request_uri; } save , exit. configures nginx redirect requests "example.com" "www.example.com". not...
Read more