image - Python ImageIO: Too many open files -

-

i using imageio in python in order open video files in directory , convert them numpy arrays.

here script using:

  1 __future__ import print_function   2 avi_to_numpy import *   3 os import listdir   4 import numpy np   5 import imageio    6          7 class_path = '../diving/'   8 max_frames = 16   9 stride = 8  10 videos = [vid vid in listdir(class_path)]  11 train = []  12   13 vid in videos:  14     print(str.format('loading {}...', vid), end="")  15     filename = class_path + vid  16     reader = imageio.get_reader(filename, 'ffmpeg')  17     frames = []  18       19     i, im in enumerate(reader):  20         if len(frames) == max_frames:  21             break  22           23         if % stride == 0:  24             frames.append(im)  25       26     reader.close()  27     train.append(np.array(frames))  28     print('done')          29   30   31 print(len(train))

eventually script crashes following error output:

traceback (most recent call last):   file "load_class_test.py", line 16, in <module>     reader = imageio.get_reader(filename, 'ffmpeg')   file "/usr/local/lib/python2.7/site-packages/imageio/core/functions.py", line 111, in get_reader     return format.get_reader(request)   file "/usr/local/lib/python2.7/site-packages/imageio/core/format.py", line 158, in get_reader     return self.reader(self, request)   file "/usr/local/lib/python2.7/site-packages/imageio/core/format.py", line 207, in __init__     self._open(**self.request.kwargs.copy())   file "/usr/local/lib/python2.7/site-packages/imageio/plugins/ffmpeg.py", line 260, in _open     self._initialize()   file "/usr/local/lib/python2.7/site-packages/imageio/plugins/ffmpeg.py", line 326, in _initialize     stdout=sp.pipe, stderr=sp.pipe)   file "/usr/local/cellar/python/2.7.11/frameworks/python.framework/versions/2.7/lib/python2.7/subprocess.py", line 710, in __init__     errread, errwrite)   file "/usr/local/cellar/python/2.7.11/frameworks/python.framework/versions/2.7/lib/python2.7/subprocess.py", line 1223, in _execute_child     errpipe_read, errpipe_write = self.pipe_cloexec()   file "/usr/local/cellar/python/2.7.11/frameworks/python.framework/versions/2.7/lib/python2.7/subprocess.py", line 1175, in pipe_cloexec     r, w = os.pipe() oserror: [errno 24] many open files

i closing reader object imageio. seems if files opened ffmpeg not being closed properly.

is there obvious step missing here? closing files properly?

edit: found temporary solution. opened new issue on github.

i able resolve issue uncommenting following lines of code 'imageio/plugins/ffmpeg.py':

381         def _close_streams(self): 382             std in (self._proc.stdin, 383                         self._proc.stdout, 384                         self._proc.stderr): 385                 try: 386                     std.close() 387                 except exception:  # pragma: no cover 388                     pass

i added call above function in _close(self):

271         def _close(self): 272             self._terminate(0.05)  # short timeout 273             self._close_streams() 274             self._proc = none

i not sure side effects of doing are, provides solution me.

here link issue: https://github.com/imageio/imageio/issues/145


Comments

Post a Comment

Popular posts from this blog

Django REST Framework perform_create: You cannot call `.save()` after accessing `serializer.data` -

-
i have following viewset: class artistprofileviewset(viewsets.modelviewset): queryset = artistprofile.objects.all() serializer_class = artistprofileserializer def perform_create(self, serializer): if serializer.is_valid(): serializer.save() with following serializers: class simpleartisttrackserializer(serializers.hyperlinkedmodelserializer): class meta: model = artisttrack fields = (...my fields...) class artistprofileserializer(serializers.hyperlinkedmodelserializer): owners = userserializer(many=true, required=false) tracks = simpleartisttrackserializer(many=true, required=false) class meta: model = artistprofile fields = (...my fields...) i getting following error: assertionerror: cannot call `.save()` after accessing `serializer.data`.if need access data before committing database inspect 'serializer.validated_data' instead. i don't see editing serializer.data object. th...
Read more

Why does Go error when trying to marshal this JSON? -

-
i'm trying rather simple example of trying decode json file structs using golang. however, when attempting error that json: cannot unmarshal object go value of type []main.track which don't understand. here's code in question, , json can found here . package main import ( "encoding/json" "fmt" "net/http" "os" ) // tracks group of track types type tracks struct { tracks []track } // track represents singular track type track struct { name string url string artist artist } // artist represents single artist type artist struct { name string mbid string url string } func main() { url := "http://ws.audioscrobbler.com/2.0/?method=geo.gettoptracks&api_key=c1572082105bd40d247836b5c1819623&format=json&country=netherlands" response, err := http.get(url) if err != nil { fmt.printf("%s\n", err) os.exit(1) } de...
Read more