Section 4 Uploading and Ingestion

Printer-friendly version

Uploading and Ingestion

This section describes the options for uploading content to Kaltura.

What is a Kaltura Entry?

A Kaltura entry is a logical reference to your media asset. An entry encapsulates all physical media files generated during ingestion (source, “flavors” and thumbnails), standard and custom metadata, captions, scheduling settings, advertising cue points, specific access control settings and all other components relating to the content. An entry is generated immediately, and your source media file starts uploading and transcoding begins. For more information, see the Entries Table

Browser-based Ingestion 

You can upload files from your computer, or import from a selection of online repositories, or submit a bulk upload request via Kaltura formatted CSV/XML all from within the Kaltura Management Console. See Creating an Entry.

Creating an Entry

The Create button presents a list of ingestion options and capabilities to choose from and is used to upload content to Kaltura. 

Upload Media

The following options are available

The Create button replaces the Upload Tab from the KMC legacy application.

To create a Kaltura entry

  • Click Create.

    The following window is displayed:

Upload from Desktop

Use this option to upload files from your desktop. You can continue working on other tasks while files are uploading and resume the file upload in case of connection failure.

To upload media files from your desktop

  1. Click Create and click Upload from Desktop.
  2. Select one or more media files. Use the Ctrl key to select multiple files. The default detection of the entry type (video/audio/image) is kept as is.
    The Upload Settings window is displayed.
  3. Select the Transcoding Profile or use the default. See Transcoding and Processing.
    The File name and size is displayed.
  4. (Optional) Modify the file name by clicking on the pencil icon or click on the Trash icon to cancel your upload.
  5. Modify the Media Type if needed. The media type is automatically detected from file name extension. The media types allowed are: video, audio or image.
  6. Click Add File. (Optional).
  7. Click Upload.

Need High Speed Upload

Kaltura’s High-Speed Upload option powered by Aspera™ is targeted at content administrators (KMC users) that upload media to their KMC account. The High-Speed Upload option is particularly useful for content administrators uploading large source files or time sensitive content on a regular basis. To access the request form, click here.

Aspera’s patented FASP™ Transport Technology is a proven standard for the high-speed movement of large files over IP Networks. It achieves speeds that are significantly faster than FTP and HTTP.  Please refer to Aspera’s FASP Benchmark information to learn more.

The High-Speed Upload option is activated by Kaltura when the High-Speed Upload option is included or added to your service agreement. For more information, see the Kaltura High-Speed Upload User Guide.

What is Bulk Upload?

Bulk Upload enables you to ingest multiple entries and files to the Kaltura server in a single action using a single file. The greatest benefit for bulking uploads is:

  • Importing multiple files in one action thus automating the ingestion process. 
  • Populating metadata fields with no need to enter them from the KMC.

Bulk upload streamlines publishing, providing the basis for automated bulk ingestion of files and metadata and overcomes browser and client upload limitations allowing for larger file size ingestion.

There are two methods to upload bulk content:  the simple method where you use a CSV file (Comma Separated Value) and the advanced method where you use an XML file, which has many extensive bulk upload features. You can customize the structure to the metadata and elements that are part of your account specific workflow. Using the XML file bulk upload is the recommended method due to its structured hierarchy, allowing for nested objects and metadata and is easily extended. 

For information on how to download bulk file samples see Downloading Bulk File Samples.

CSV Bulk Upload

You can use the CSV format for simple content ingestion based on imported source media files and their related metadata. Each entry is added from a single line in the CSV file. Each line includes a path to a media file that will be uploaded, and each uploaded media file creates an entry. We recommend a maximum of 500 lines/uploaded media files included within one CSV file.

Entries XML Bulk Upload

XML Bulk Upload supports full CRUD (Create, Read, Update, and Delete) operations, allowing for ingestion of entries, updates to existing entries, and deletion of bulk entries using an XML format. XML Bulk Upload is the recommended bulk upload option.

In addition, XML supports a hierarchical structure while CSV does not. You can define a complete content package using the XML Bulk Upload feature that includes the video source file, its metadata, its custom metadata profiles, distribution profiles, set of transcoding flavors (for cases when you are using your own transcoders), thumbnails and other additional relevant data.

The advantages of using XML Bulk Upload are:

  • Simplified integration with other systems (for example, migrating media files including their complete metadata from one server to another).
  • A streamlined ingestion mechanism, by using XML it is easy to create automated processes to ingest content.
  • More comprehensive ingestion models that allow you to manipulate all the media entry object attributes and their related objects (such as flavors, custom metadata, access control and distribution profiles, etc.).

The full sets of features supported by the XML Bulk Upload are described in the XSD (the XML template).

An example XML file can be found here (or downloaded from the KMC Create button).

The XML Bulk Upload file is based on Kaltura’s MRSS format schema for content ingestion. The XML format enables bulk ingestion of complex video or audio packages. 

  • Complex packages may include:
  • Multiple bit-rate Transcoding Flavors already transcoded by a local transcoder
  • Multiple thumbnails
  • Related metadata and publishing options

The bulk upload status is monitored through the Bulk Upload Log Page. A log file and a copy of the CSV file are made available for troubleshooting or for historical records of uploaded content.  

Whether you are a medium sized video publisher or if you're a media giant, you should consider the Bulk Upload option.

Uploading Entries in Bulk

To upload Kaltura entries in bulk 

  1. Click Create and click Bulk Upload.
  2. Select the entity type. 
  • Entries
  • Categories
  • End Users
  • End Users Entitlements
  • Select the file and click Open.
  • Track the bulk upload in the Bulk Upload Log page.
  • The Bulk Upload Log Page

    The Bulk Upload Log Page contains the following information for each uploaded file:

    • Original file name
    • Uploaded item
    • Uploaded by
    • Uploaded on
    • Number of items
    • Status
    • Notification
    • Actions

     You may perform the following actions for each file displayed in the Bulk Upload Log page:

    • Download Log File
    • Download Original File
    • Delete

    Downloading Bulk File Samples

    To download a sample bulk file 

    1. Click Create and click Download CSV/SML Samples.
    2. Open the downloaded folder. (kaltura_batch_upload_sample)

    The samples include specific format descriptions and guidelines for the following:

    What is a Drop Folder?

    Kaltura Drop Folders are used to automate the ingestion of content into the Kaltura platform. The Drop Folder service constantly watches each drop folder for new content and activates automatic ingestion of new content to the specific account.

    Kaltura offers multiple configuration options for setting each drop folder to a specific workflow. To learn more read about Drop Folders see Kaltura Drop Folder Service for Content Ingestion

    Automated Content Ingestion via a Drop Folder

    You can add your media and metadata to a drop folder (On-Premise or on the Kaltura servers) and the Kaltura system will activate an ingestion workflow tailored to your needs.  

    You can also upload metadata only and deliver media directly from your CDN, or On-Premise storage. 

    Drop Folder Table

    This section applies only after the Kaltura Drop Folder service is set up. 

    The drop folder capability allows you to easily trigger content ingestion by dropping files into a folder in your environment. In the KMC Content tab, publisher administrators can use a control panel to monitor and troubleshoot media files in drop folders. Access to the Drop Folders table can be granted to specific administrators through the administrator's user role definition. 

    The Drop Folders table includes the status of each file in the drop folder. Use the Search or Refine option options to filter the file display for a specific drop folder, status and creation date range. 

     

    An additional option to manually delete files from the drop folder can be granted separately only to authorized administrators. 

    You can filter the files by:

    • Search criteria
    • Drop folder
    • File creation date
    • Drop folder status

    If you need to delete files from the drop folder, click Delete from the Actions menu (3 dots).

    To Delete Multiple Files from Drop Folders

    • Check the checkboxes near the File Names you want to delete and click the Trash icon.

    Drop Folder Statuses

    The following statuses describe the different stages and possible error cases that may apply to a specific file in the drop folder:

    • Parsed from XML – A reference to the media file was parsed from the XML. The media file is expected but is not yet available in the drop folder.
    • Uploading – File is currently uploading to the drop folder.
    • Pending – File upload is completed - Waiting for drop folder processing to start.
    • Waiting for Related Files (Formerly “Matched”) –Processing of this file should continue when all related files are available in the drop folder (for example, XML file, other media files referenced in the same XML, or other flavors expected for the same entry).
    • Waiting for Matched Entry (Formerly “Not Matched”) – Processing of this file should continue when a matched entry is found (applicable only in specific drop folder workflows settings)
    • Processing - Drop folder engine is currently processing this file.
    • Downloading - The file is currently importing from the drop folder to Kaltura (applicable only in drop folders hosted On-Premise by customers)
    • Done– Drop folder processing was completed for this file.
    • Error – Drop folder engine processing failed.
    • Download Failed - Failed to import the file from the drop folder to Kaltura (applicable only in drop folders hosted On-premise by customers)
    • Delete Failed - Failed to delete the file from the drop folder.

    Commercial users, please contact your account manager to enable this feature in your account.

    The Upload Monitor

    The Upload Monitor displays uploads according to the way the entries were uploaded and is set to monitor the following types of uploads:

    To track all uploads

    1. Click Upload Monitor.
      The Upload Monitor table is displayed.
    2. Click View Details for more information.

    Upload from URL

    Use this option to add media from a URL.

    To upload media from a URL

    1. Click Create.
    2. Click Upload from URL.
    3. Select the Transcoding Profile from the drop-down list.
    4. Enter the File URL and click Upload.
    5. Click Add Files to add multiple files.

    Create a Live Stream Entry 

    Use this option to create live stream entries from your desktop. You can continue working on other tasks while files are uploading and resume the file upload in case of connection failure.

    Use the Live Stream Entry option to provision a live stream on the CDN. The live stream should be configured with your encoder IP address. 

    After the live stream is provisioned, you can set the entry metadata and specific broadcasting settings in the KMC's Content tab Entries tab.

    Perform the steps described in Getting Started with Kaltura Live KMC-NG  to create and broadcast a live stream. For additional information see the Live Streaming  articles on the Knowledge Center. You do not need to list your IP when setting up a Kaltura live stream.

    To create a live stream entry from your desktop

    1. Click Create.
    2. Click Create Live Stream Entry.
    3. Select the Live Stream Type. 

      Field

      Description

      Live Stream Type

      Kaltura Live Streaming (HDS / HLS / DASH) – This is the default and recommended live streaming type. Kaltura Live Streaming services are provisioned within the Kaltura data centers. Cloud transcoding, extended DVR window, live to VOD recording with a single embed code, instant provisioning, and multi-protocol delivery are supported. Depending on your live streaming package, simultaneous cloud transcoding may be restricted.

      Universal Streaming, Flash and Mobile (HDS / HLS) - Supports both Flash HDS (Adobe HTTP Dynamic Streaming) and HLS (Apple HTTP Live Streaming) from a single ingested stream. Akamai universal live streaming also supports DVR functionality that allows you to seek back in time within the live stream window. The default DVR window is 30 minutes. Contact Kaltura for more information.

      Manual Live Stream URLs - This mode allows you to associate custom live external URLs with a Kaltura live entry. This option is useful if you are using a 3rd party to provision and broadcast a live stream.

    4. Enter a Name and Description.

      Name – Required - minimum 5 characters. The name of the stream that will appear in the KMC entries list.

      Description - A description of the stream (Optional).

    5. Enter the relevant parameters for the chosen type of live stream.
    6. Click Create Live Stream. 

    The required fields depend on the Live Stream Type you select. An indication is displayed when required fields are not populated. 

    A message is displayed indicating that you have created a live stream entry.

    Kaltura Live Streaming (HDS / HLS / DASH)

    The following are the Required/Optional fields for Kaltura Live Streaming (HDS / HLS / DASH):

    Field

    Description

    Live Transcoding Profiles

    Select a transcoding profile from the drop-down list. The available options are Cloud Transcode and Pass-through. For more information see How to Set Transcoding Profiles for Live Streaming.

    Cloud Transcode– This option enables cloud transcoding for this live entry. A single bitrate coming from your encoder will be transcoded in the Kaltura cloud into multi-bitrate flavors. The default cloud transcoding profile includes the source stream along with transcoded flavors. You can set additional transcoding profiles for live streaming.

    To customize transcoding profiles or broadcast multiple cloud-transcode streams simultaneously, please contact your Kaltura account manager.

    Passthrough- This option enables passthrough mode for this live entry. Kaltura will deliver the stream(s) from your encoder without re-encoding.

    Live DVR

    Check this to enable Live DVR. Live DVR provides the ability to seek back within the live stream up to 2 hours prior to the current live point. The DVR duration can be extended up to 24 hours. To extend the time, please contact your Kaltura account manager.

    Enable Recording

    Check this to enable recording of the live stream into a VOD available for later viewing.  Select one of the following options:

    Append the recorded content to a single entry - This option appends any live stream recording into the same VOD. Choose it if want to append several live events into one recording.

    Create new Entries for each broadcast session - This option creates a new VOD for each broadcast session. In this mode each live event is recorded in a different VOD.

    To split recordings between broadcast sessions, we recommend stopping broadcasting for at least 5 minutes before starting a new event. Otherwise the system assumes an accidental disconnect and will continue appending the recorded content.

    Notes:

    1) Recordings are limited to 24 hours. After 24 hours, recording will stop.

    2) Recording is done on the account's primary data center. make sure you're streaming to the primary RTMP URL

    Preview Mode

    Uncheck this option to enable the Preview Live feature. Otherwise, broadcasting will automatically go live when you start the encoder. Preview is enabled by default. For more information about Preview Mode see Kaltura Live - Preview Live.

     

    Universal Streaming (HDS/HDLS) 

    The following are the Required/Optional fields for Universal Streaming Flash and Mobile (HDS / HLS:

     

     

    Field

    Description

    Primary encoder IP

    Required, must match “ip” format (can be IP6) The public address that will be used for streaming (the computer where the client encoder, for example Adobe FMLE is installed).

    Note: your IP address can be retrieved by browsing from the computer where the FMLE is installed to http://www.whatismyip.com/  0.0.0.0 cannot be used as your IP address.

     

    Secondary encoder IP

    Required (can be the same as primary). If you are using two encoders (for redundancy), fill in the secondary encoder IP. If you are using a single encoder, copy the Primary encoder IP to the Secondary encoder IP field.

    Broadcast Password

    (Optional) This password is required in the client encoder (FMLE) software. If you do not enter a password the system will automatically create one for you and it will be displayed in the Live Stream tab of the entry details window under “Broadcasting credentials”.

    Live DVR

    Check this to enable Live DVR. Live DVR provides the ability to seek back within the live stream up to 2 hours prior to the current live point. The DVR duration can be extended up to 24 hours. To extend the time, please contact your Kaltura account manager. The following message is displayed.


     

    The Entries table will indicate that your Universal Stream is Provisioning and will update the status to ready when ready.

     

    .

     

     

     

     

     

     

     

     

     

     

     

     

     

     

     

     

     

     

     

     

     

     

     

     

     

     

     

     

     

     

    Manual Live Stream URLs

    The following are the Required/Optional fields for the Manual Live Stream URLs stream type.

    Field

    Description

    Live Flash HDS stream URL

    Required: type URL

    Live Mobile HLS stream URL

     

    Akamai HD protocol is used on  this HDS URL

    Optional: Check to allow Akamai HD protocol

    Prepare Entry

    You can prepare a video entry without including the media content in advance.  Creating a No Media entry may be useful when metadata settings and media perpetrations are managed separately and possibly by different operational teams This scenario is used for media that may be included at a later stage, for example when linking to remote storage.

    The following options are available:

    Prepare Video Entry

    Use this option to prepare metadata and publishing settings for a video/audio entry before its related files are ready for upload. This option enables a flexible entry preparation workflow and is especially useful when video files are:

    • Transcoded by a local transcoder
    • Processed while content editorial work is being done in the KMC
    • Processed after content editorial work is completed in the KMC

    Preparing a Draft Entry Workflow:

    1. Prepare a draft entry in the KMC and fill in its metadata and publishing settings. 
    2. Add the media source file or the locally generated Transcoding Flavors to the entry. Use the entry’s Flavors tab to add files or flavors. See The Flavors Tab.

    The ingestion status of an entry that you create with the Prepare Video/Audio Entry option automatically is set to No Media. The status remains No Media until one or more media files are added to the entry.

    An entry that you create with the Prepare Video/Audio Entry option is saved as a Draft entry in the Kaltura system until you add content.

    A Draft entry remains available in the Content tab Entries table for further editing.

    Prepare Audio Entry

    Use this option to prepare metadata and publishing settings for a video/audio entry before its related files are ready for upload. This option enables a flexible entry preparation workflow and is especially useful when video files are:

    • Transcoded by a local transcoder
    • Processed while content editorial work is being done in the KMC
    • Processed after content editorial work is completed in the KMC

    Preparing a Draft Entry Workflow:

    1. Prepare a draft entry in the KMC and fill in its metadata and publishing settings. 
    2. Add the media source file or the locally generated Transcoding Flavors to the entry. Use the entry’s Flavors tab to add files or flavors. See The Flavors Tab.

    The ingestion status of an entry that you create with the Prepare Video/Audio Entry option automatically is set to No Media. The status remains No Media until one or more media files are added to the entry.

    An entry that you create with the Prepare Video/Audio Entry option is saved as a Draft entry in the Kaltura system until you add content.

    A Draft entry remains available in the Content tab Entries table for further editing.

    Creating Draft Entries

    Draft entries are entries created without actual content and are used as a container for adding content. 

    You can add or attach content at a later time, by using the BaseEntry->addContent  action and use one of the KalturaResource resources. See Kaltura API documentation.

    To create a Draft Entry

    1. Click Create.
    2. Select Video Entry or Audio Entry.
    3. If you have permissions select the Transcoding Profile and click Apply.

    4. In the New Entry Window, provide:
      1. Name (required).
      2. Description
      3. Tags
      4. Categories – Click Browse Categories to select a category from the existing category list.
    5. If you have Custom Data for entries, you can edit the Custom Data fields for the entry. For multiple schemas, use the drop-down Jump To menu to select the schema for the entry. See Managing Schemas for more information.
    6. Click Save.

    The ingestion status for a Draft entry is No Media. The following is an example of a Draft entry in the KMC.

    Key Benefits and Functionality of Draft Entries

    You can prepare a new media entry in the KMC and set its metadata and publishing information beforehand, or in parallel, to the actual media processing and then add the media files to the existing entry when ready.  

    This flexibility may be of value especially with large media operational teams, when the metadata preparation effort is separated from the media preparation effort with different teams working on each operation.  Separating these tasks, may provide more efficiency to the company’s internal processes as editing metadata can be done without dependency on the media preparation operation.

    When you prepare a No Media entry in the KMC you can upload the media file/s to Kaltura later either by uploading the source for transcoding in Kaltura or uploading media assets/files that have already been generated locally using your own transcoder. 

    Note that the option to use a local transcoder to ingest flavors is a feature that is not enabled by default. Contact your Kaltura account manager to learn more about how this feature can simplify your workflow, and to activate and configure this feature on your account.

    Hosting Videos at your Preferred Location and Linking to Kaltura

    This use case is typically combined with transcoding performed on the publisher’s side, after which the output files are pushed directly to CDN hosting, or to a local intranet delivery source. 

    In this case, Kaltura essentially only manages the metadata while media files themselves are delivered directly from the publisher through a CDN to the viewer.

    Linking between the files and a Kaltura entry can be done through the KMC, API, or drop folder XML ingestion. 

    Replacing Video Assets for a Kaltura Entry 

    Publishers can replace media files of an existing media entry when needed. 

    This feature is especially useful when media assets need to be re-edited by the publishers following ingestion to Kaltura.

    • Enables seamless replacement of media even if media is already published/ syndicated/distributed – media is replaced in all published instances.
    • Replaces all multiple-bitrate media assets flavors in one transaction.
    • Allows review and approval of new media prior to the actual replacement.
    • Is an integral part of the entry life-cycle and content management workflow.

    For more information see Replacing Media.

    Uploading and Modifying Related Files

    You can attach files (documents, media) to your entries. Uploaded files will not create new entries but will receive a unique Kaltura Asset ID. Use the Related Files tab to upload files associated to entries. Related files are not stored with the entries on the Kaltura platform and are referenced using an Asset ID.

    To upload related files

    1. Select the Content menu and click on an entry.
    2. Select the Related Files tab and click Add File.
    3. Select a file and click Open.
    4. Select the File Type from the drop-down menu.
      The related file will immediately begin uploading. After the upload is complete, you can edit the file details (Title, Description), download the file, or remove it
    5. Continue to Add files as relevant.
    6. Click Save. 

    To edit related files

    1. Select the Content menu and click on an entry.
    2. Select the Related Files tab.
    3. Select a File and select Edit, Download, or Remove.

     

     

    (3975 reads)