{"id":2796,"date":"2024-02-23T10:07:46","date_gmt":"2024-02-23T02:07:46","guid":{"rendered":"https:\/\/fipeadesign.com\/?p=2796"},"modified":"2024-11-18T12:09:46","modified_gmt":"2024-11-18T04:09:46","slug":"knowledge-sharing-ai-sora","status":"publish","type":"post","link":"https:\/\/fipeadesign.com\/en\/2024\/02\/23\/knowledge-sharing-ai-sora\/","title":{"rendered":"Sora\uff1aCreating Video from Text"},"content":{"rendered":"
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\n\t\t
\n\n\t\t\t\t\t\t\t\t

\n\t\t\t\t\t\t\t\t\n\t\t\t\tSora\uff1aCreating Video from Text \n\t\t\t<\/h3> \n\t\t\t\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

<\/p>\n

February 22, 2024<\/span><\/p>\n

\"\"
Photo by cw from google
<\/span><\/p>\n

\n
\u3010This article aims to inform you about...\u3011
1. What is Sora ?
2. Sora adopts what technology ?
3. The current shortcomings of the Sora model ?
4. Who can use Sora ?
5. When will Sora be available for use ?<\/b><\/pre>\n
The recent release of OpenAI's video generation AI, Sora, has garnered widespread attention globally, particularly sparking intense discussions in the field of film and television creation. On the OpenAI forum, some threads with topics like \"Sora might ruin many people's lives\" have ignited strong debates. Opponents of Sora express concerns that the emergence of this technology could potentially mean the end of careers for photographers, artists, filmmakers, and others in related professions. This has triggered in-depth reflections on the various challenges and opportunities that creators might face in the future. A former Disney animator stated that the current worries about the impact of AI-generated videos on the industry are reminiscent of concerns decades ago when the animation industry transitioned from 2D to 3D.<\/p>\n
\"\"
Photo by OpenAI from google<\/span><\/p>\n
Sora-generated videos come with a vertical bar watermark in the lower-right corner. This is intended to provide visual evidence to distinguish whether the video was generated by AI rather than being shot by a real person. The design aims to ensure that viewers can clearly differentiate content created by Sora, maintaining transparency and accuracy. The introduction of this identification mark is intended to enhance awareness of AI-generated content while safeguarding the audience's understanding of the authenticity of the videos.<\/p>\n
So, what exactly is Sora? Here are six key questions to explore about Sora:<\/p>\n
    \n
  1. What is Sora?<\/strong>

    Sora is a generative AI model introduced by OpenAI, capable of creating realistic and imaginative scene videos based on textual instructions. According to OpenAI's explanation, upon receiving textual instructions, the model can generate videos with a maximum duration of up to 1 minute while maintaining visual quality and adherence to user prompts. OpenAI states that they are teaching AI to understand and simulate the physical world in motion, with the aim of training models that help people solve problems requiring real-world interaction.

    \n
  2. Sora adopts what technology?<\/strong>

    \n
    Sora is a diffusion model, generating videos by initially creating one that looks like static noise and gradually eliminating the noise over many steps. Sora can generate entire videos at once or extend already generated videos to make them longer. By providing the model with foresight of multiple frames at a time, they have addressed the challenge of ensuring a subject remains consistent even when temporarily out of view.<\/p>\n
    Similar to GPT models, Sora utilizes a transformer architecture, unlocking superior scaling performance.

    Videos and images are represented as collections of smaller units of data called \"patches,\" each of which is similar to a token in GPT. By unifying how we represent data, we can train diffusion transformers on a wider range of visual data than was possible before, spanning different durations, resolutions, and aspect ratios. Sora builds on past research in DALL\u00b7E and GPT models. It uses the recaptioning technique from DALL\u00b7E 3, which involves generating highly descriptive captions for the visual training data. As a result, the model is able to follow the user's text instructions in the generated video more faithfully.<\/p>\n
    http:\/\/fipeadesign.com\/wp-content\/uploads\/2024\/02\/gold-rush.mp4<\/a><\/video><\/div><\/p>\n
    Prompt: Historical footage of California during the gold rush.<\/span><\/p>\n<\/li>\n
  3. The current shortcomings of the Sora model?<\/strong>

    \n
    The current model still has some limitations. It may struggle with accurately simulating the physics of complex scenes and may not understand specific instances of cause and effect. For example, a person might take a bite out of a cookie, but afterward, the cookie may not have a bite mark.<\/p>\n
    The model may also confuse spatial details of a prompt, for example, mixing up left and right, and may struggle with precise descriptions of events that take place over time, like following a specific camera trajectory.<\/p>\n
    http:\/\/fipeadesign.com\/wp-content\/uploads\/2024\/02\/backward-jogger.mp4<\/a><\/video><\/div><\/p>\n
    Prompt: Step-printing scene of a person running, cinematic film shot in 35mm.<\/span><\/p>\n<\/li>\n
  4. Who can use Sora?<\/strong>

    OpenAI stated that they are collaborating with red teamers, who are domain experts in areas like misinformation, hateful content, and bias. These experts will be adversarially testing the model. Additionally, OpenAI has invited designers, producers, and visual artists to participate in the trial to gather their feedback and suggestions, aiming to further optimize the performance and applications of Sora.

    <\/li>\n
  5. When will Sora be available for use?<\/strong>

    OpenAI has not provided a specific timeline for the release of Sora. They emphasized that before opening it to the general public, the tool will undergo safety drills and misinformation testing. Additionally, they are testing tools to assist in detecting deceptive content. Ideally, once it is open for use, any instructions involving explicit content, violence, hate, celebrities, and other sensitive topics will be detected and rejected.<\/li>\n<\/ol>\n
    —<\/p>\n
    Source of information:OpenAI<\/a><\/p>\n
    <\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>","protected":false},"excerpt":{"rendered":"
    Sora\uff1a\u5f9e\u6587\u5b57\u5efa\u7acb\u8996\u983b February 22, 2024 Photo by cw from google  […]<\/p>\n","protected":false},"author":1,"featured_media":4485,"comment_status":"open","ping_status":"open","sticky":false,"template":"elementor_header_footer","format":"standard","meta":{"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","ast-disable-related-posts":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"set","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":""},"categories":[26],"tags":[43],"class_list":["post-2796","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-26","tag-43"],"_links":{"self":[{"href":"https:\/\/fipeadesign.com\/en\/wp-json\/wp\/v2\/posts\/2796","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/fipeadesign.com\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/fipeadesign.com\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/fipeadesign.com\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/fipeadesign.com\/en\/wp-json\/wp\/v2\/comments?post=2796"}],"version-history":[{"count":1,"href":"https:\/\/fipeadesign.com\/en\/wp-json\/wp\/v2\/posts\/2796\/revisions"}],"predecessor-version":[{"id":4486,"href":"https:\/\/fipeadesign.com\/en\/wp-json\/wp\/v2\/posts\/2796\/revisions\/4486"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/fipeadesign.com\/en\/wp-json\/wp\/v2\/media\/4485"}],"wp:attachment":[{"href":"https:\/\/fipeadesign.com\/en\/wp-json\/wp\/v2\/media?parent=2796"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/fipeadesign.com\/en\/wp-json\/wp\/v2\/categories?post=2796"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/fipeadesign.com\/en\/wp-json\/wp\/v2\/tags?post=2796"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}