python lxml xpath get the nodes attributes with specific string pattern -

-

im learning xpath , trying value of node specific node attribute example(google playstore) using python lxml/html. below code wanted developer email value node "a" attribute "href" starting "mailto:". python code snippet returns app name empty developer email. thank you

<html> <div class="id-app-title" tabindex="0">candy crush saga</div> <div class="meta-info meta-info-wide">  <div class="title"> developer </div>  <a class="dev-link" href="https://www.google.com/url?q=http://candycrush.com" rel="nofollow" target="_blank"> visit website </a> <a class="dev-link" href="mailto:candycrush@kingping.com" rel="nofollow" target="_blank">candycrush@kingping.com </a> ##interesting part here </div> </html>

python code (2.7)

 def get_app_from_link(self,link):     start_page=requests.get(link)     #print start_page.text     tree = html.fromstring(start_page.text)     name = tree.xpath('//div[@class="id-app-title"]/text()')[0]     #developer=tree.xpath('//div[@class="dev-link"]//*/div/@href')     developer=tree.xpath('//div[contains(@href,"mailto") , @class="dev-link"]/text()')     print name,developer     return

now using tag div, not a:

'//a[contains(@href,"mailto") , @class="dev-link"]/text()'

also, function don't return items. use return like:

def get_app_from_link(self,link)::     # code     return name, developer

Comments

Post a Comment

Popular posts from this blog

Django REST Framework perform_create: You cannot call `.save()` after accessing `serializer.data` -

-
i have following viewset: class artistprofileviewset(viewsets.modelviewset): queryset = artistprofile.objects.all() serializer_class = artistprofileserializer def perform_create(self, serializer): if serializer.is_valid(): serializer.save() with following serializers: class simpleartisttrackserializer(serializers.hyperlinkedmodelserializer): class meta: model = artisttrack fields = (...my fields...) class artistprofileserializer(serializers.hyperlinkedmodelserializer): owners = userserializer(many=true, required=false) tracks = simpleartisttrackserializer(many=true, required=false) class meta: model = artistprofile fields = (...my fields...) i getting following error: assertionerror: cannot call `.save()` after accessing `serializer.data`.if need access data before committing database inspect 'serializer.validated_data' instead. i don't see editing serializer.data object. th...
Read more

Why does Go error when trying to marshal this JSON? -

-
i'm trying rather simple example of trying decode json file structs using golang. however, when attempting error that json: cannot unmarshal object go value of type []main.track which don't understand. here's code in question, , json can found here . package main import ( "encoding/json" "fmt" "net/http" "os" ) // tracks group of track types type tracks struct { tracks []track } // track represents singular track type track struct { name string url string artist artist } // artist represents single artist type artist struct { name string mbid string url string } func main() { url := "http://ws.audioscrobbler.com/2.0/?method=geo.gettoptracks&api_key=c1572082105bd40d247836b5c1819623&format=json&country=netherlands" response, err := http.get(url) if err != nil { fmt.printf("%s\n", err) os.exit(1) } de...
Read more