Id like to hear more of what you have in mind…
perhaps I can come up with something (simple) to test what you have in mind is possible.
e.g. do you have resolutions in mind? size of videos?
here is what Ive seen so far, about moviepy:
- its built around a concept of clips,
- initially the clip is the whole movie, but you can create new clips, by taking subclips, compositing with other clips, apply fx to clips etc…
- then during the pygame draw, I grab a frame from the clip , and then render it (similar way to drawing)
- this means we are limited to the 30fps , that we have in the main pgygame rendering (unless i change etc_mother)
- im not sure why, but when i accessed frames in sequential order, it was quicker… so I’m guess there must be some optimisations.
- Ive not tested, but I believe i could also still draw onto the screen , during this render . using the pygame api
what I’m not sure of yet is… when you ‘create new clips’ does this really take copies/pre-process the clip, or does it just form a ‘render chain’ on a modified timeline - I think this is the case.but hopefully with some optimisations
e.g. one test Id like to do is:
render a clip in reverse by asking for frames from (N to 1) … (ive done this , and its ‘slow’)
compare this to using a clip fx, asking for a reverse timeline… is this effectively the same, or does it do something extra.
also can we do a certain amount of the rendering ‘up front’
this also leads to questions of where are we bound? the speed of the SD card read (Im reading off the sdcard, not usb fortunately!) and/or the processing required e.g. uncompressing the data stream… is there a way of doing this ‘upfront’
(or put another way, why was the 720p video I rendered, so much slow that the small video i initially tested with)
also I need to think about possibilities ‘upfront rendering’,
one other thing to note… is there is a ‘cost’ to load the movie, so if you had a lot of movies in modes, it might take a few seconds for ETC to start. … also i need to check memory consumption to see if this is viable.
also, Id like to look at the ETC/OTC use of python/pygame, in particular can I give it a higher priority?, or setup the graphics rendering to be more efficient?
this is all rather experimental as moviepy is not very well documented, and where are very few examples of pygame with moviepy, hence many questions.
so as i said… Ive a suspicion this is going to not so much about ‘is it possible to X?’ rather, thinking creatively about using the constraints we find, and seeing what we can make within those…
EDIT: ok, got ETC running on my desktop now, much easier to develop the graphics modes here…
though I think i need to now develop something for the Organelle so I can use it as a a control surface