nlp - Predicting next word with text2vec in R -

-

i building language model in r predict next word in sentence based on previous words. model simple ngram model kneser-ney smoothing. predicts next word finding ngram maximum probability (frequency) in training set, smoothing offers way interpolate lower order ngrams, can advantageous in cases higher order ngrams have low frequency , may not offer reliable prediction. while method works reasonably well, 'fails in cases n-gram cannot not capture context. example, "it warm , sunny outside, let's go the..." , "it cold , raining outside, let's go the..." suggest same prediction, because context of weather not captured in last n-gram (assuming n<5).

i looking more advanced methods , found text2vec package, allows map words vector space words similar meaning represented similar (close) vectors. have feeling representation can helpful next word prediction, cannot figure out how define training task. quesiton if text2vec right tool use next word prediction , if yes, suitable prediction algorithm can used task?

you can try char-rnn or word-rnn (google little bit). character-level model r/mxnet implementation take mxnet examples. possible extend code word-level model using text2vec glove embeddings.

if have success, let know (i mean text2vec or/and mxnet developers). interesting case r community. wanted perform such model/experiment, still haven't time that.


Comments

Post a Comment

Popular posts from this blog

Django REST Framework perform_create: You cannot call `.save()` after accessing `serializer.data` -

-
i have following viewset: class artistprofileviewset(viewsets.modelviewset): queryset = artistprofile.objects.all() serializer_class = artistprofileserializer def perform_create(self, serializer): if serializer.is_valid(): serializer.save() with following serializers: class simpleartisttrackserializer(serializers.hyperlinkedmodelserializer): class meta: model = artisttrack fields = (...my fields...) class artistprofileserializer(serializers.hyperlinkedmodelserializer): owners = userserializer(many=true, required=false) tracks = simpleartisttrackserializer(many=true, required=false) class meta: model = artistprofile fields = (...my fields...) i getting following error: assertionerror: cannot call `.save()` after accessing `serializer.data`.if need access data before committing database inspect 'serializer.validated_data' instead. i don't see editing serializer.data object. th...
Read more

Why does Go error when trying to marshal this JSON? -

-
i'm trying rather simple example of trying decode json file structs using golang. however, when attempting error that json: cannot unmarshal object go value of type []main.track which don't understand. here's code in question, , json can found here . package main import ( "encoding/json" "fmt" "net/http" "os" ) // tracks group of track types type tracks struct { tracks []track } // track represents singular track type track struct { name string url string artist artist } // artist represents single artist type artist struct { name string mbid string url string } func main() { url := "http://ws.audioscrobbler.com/2.0/?method=geo.gettoptracks&api_key=c1572082105bd40d247836b5c1819623&format=json&country=netherlands" response, err := http.get(url) if err != nil { fmt.printf("%s\n", err) os.exit(1) } de...
Read more