8/13/2023 0 Comments Using roll with it pathfinderWe have fundamentally rebuilt the entire video production ‘stack’ from scratch. “With every single step, when the video and audio file hops from one software to another, it loses context and just becomes a ‘dumb’ file that is passed around. “Today, video production requires many pieces of hardware and software to fully complete,” Buzdar said. (Users can still change and adjust the camera angles or add camera movements and visual effects if they choose.) In the near future, Roll will be able to publish directly to social media, including TikTok, YouTube and Instagram - in both the appropriate resolution and aspect ratio. Similar to a few other “AI-enabled” mobile video editors on the market, Roll also taps the metadata to create a fully realized, multicamera reel in its editing cloud - no manual editing required. The metadata’s used to automatically adjust the cameras and sensors on the phone as well as provide feedback and instruction for composition and lighting. ![]() ![]() As Roll records video, it gathers metadata for use later in the video production process, including recording and lighting conditions, the distance from the camera to the subject and the position of the subject’s face and body. But Roll has other, more realistic algorithmic tricks up its sleeve. Image Credits: RollĪny visual effects sounds like a bit of a stretch. “Our technology provides foundational capabilities to simulate any visual effects a user would want.”Ĭall recording with Roll. “ We’ve researched this quite a bit, and we’ve not seen anyone use AI in the same way we are - pairing iPhone sensor data with large AI models in the cloud,” Buzdar said. But in short scenes, the AI effects are convincing enough - and an eye-catching addition to what’d otherwise be a dull remote interview. Some of Roll’s AI-generated pans broach the uncanny valley, the result of unnatural warping on objects in the background as the virtual camera swivels by. The results aren’t half bad - at least in the demo footage that Buzdar showed me. Roll started training its algorithms with open source datasets commonly used for benchmarking in academia, but then internally recorded over 22,000 video calls, creating its own rich database. A new app for iOS, it delivers bokeh, multicam shots, motion graphics and - perhaps most intriguing to me - “AI-simulated” sliders, dollies and jibs.īuzdar explained that Roll’s AI was trained to understand the 3D depth in a scene, using data to measure depth and shapes independent of the person sitting in the room. ![]() Buzdar tapped Adeel Abbas, a video engineer who while at Twitter contributed to the infrastructure powering the site’s livestreaming features, alongside Saj Khan, Fahad Yaqub and fellow Box exec Michelle Oh to explore the frontiers of tech-accelerated video production. So while at Box, Buzdar says that he decided to try combining video - an increasingly popular medium - with innovations in AI and machine learning to attempt to improve the video capturing and editing experience. “Meanwhile, I noticed that iPhone camera and sensor technology had step-function improvements over the past few years, becoming almost equivalent in image quality to DSLRs.” “A lifelong video and photography enthusiast, I’d been making videos on my own for years but noticed video production had largely remained manual with little innovation in recent decades, especially for time-consuming tasks like video editing,” Buzdar told me via email. But Buzdar, whose background is in electronics engineering, has long held a fascination with video and visual effects. Those familiar with Faizan Buzdar, who was until recently the VP of product management at Box, likely associate the entrepreneur with Convo, the digital workspace platform popular among newsrooms (including this one).
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |