シルクラボラトリとのミーティング

TV2Web:メタデータ付きビデオのWeb
コンテンツへの自動変換
Mahendren Munisamy,角谷和俊,田中克己
京都大学 情報学研究科
社会情報学専攻
制御
• 映像とメタデータからWebを生成
– ズーム操作で映像とWebコンテンツの切り替え
• 映像データの画面サイズの変化
– フォーカス操作で指定範囲の中心点を移動
Zoom in
Focus
Zoom out
メタデータと画像データの格納
• 与えられたデータ
– ビデオ映像
• ショット,シーン,セグメントに分割
• 各区間から適切な映像データの抽出
– タイムコード付きメタデータ
• ビデオ映像におけるショットレベルの字幕データ
– 下位層の字幕を結合上位層のメタデータを生成
セグメント区間
シーン区間
ショット区間
画像とメタデータデータの生成
ビデオ映像の分割
Shot
Scene
Segment
映像データ
メタデータ
(1)ショット:30fps
(2)シーン:15fps
(3)セグメント:5fps
(1)番組タイトル
ex:CNN Headline News
(2)セグメントタイトル
ex:天気,スポーツ……
(3)ショットの字幕データ
ex: 0-4: Not many singers are nominated
アプローチ
•各区間(ショット,シーン,セグメント)をブロック構造に変換
•ブロックはセルから構成
ex:ショットのブロックにおいてあるセルは一つのショットを代表
•セルは映像データとメタデータを格納
ビデオ映像
セル
映像データ
メタデータ
Not many
singers are
nominated
for a
Grammy
for their
very first
What’s so
great
about you
is that
you’re no
different
from the
What’s so
great
about you
is that
you’re no
different
from the
ブロック
ブロック構造の性質
• ブロックの観察範囲
– ブロック内のコンテンツに限定
ブロックから出ている
領域の観察が不可能
•複数のブロックの可視状態
–ディスプレー上によるブロック重複の解決
表示中の
ブロック
他のブロック
非常時
ブラウジング機能
Shot Scene
指定区間
Segment
Zoom-Out
Zoom in
Focus
Zoom
out
•Zoom-In
-映像データ:面積が増加
-メタデータ: LODが低下
•Zoom-Out
-映像データ:面積が低下
-メタデータ: LODが増加
Focus
Zoom
out
Focus
•Focus
-指定範囲の中心点の移動
Zoom-Out機能
面積の下界
(1)観察中のブロックにおいて全て
のセルの映像データの縦と横の長
さを一定の値で低下
新たな面積の上界
新たな面積
の下界
(2)メタデータのフォントサイズを一
定の値で増加
(3)セルの映像データの縦或いは
横の長さはある値域値より小さくな
ると上位層のブロックを表示
面積の上界
Zoom-In機能
(1)観察中のブロックにおいて全て
のセルの映像データの縦と横の長
さを一定の値で増加
新たな面積の上界
新たな面積
の下界
(2)メタデータのフォントサイズを一
定の値で低下
(3)セルの映像データの縦或いは
横の長さはある値域値より大きくな
ると下位層のブロックを表示
Focus機能
Focus操作で指定範囲の中心点を移動centering
ブロック
Not
many
singers
are
nomin
ated
for a
Gramy
What’s
so
great
about
you is
that
you’re
no
C:
Yeah,
this is
my
third
album,
it’s
called
It’s
incredi
ble
becaus
e to be
nomin
ated
for a
セル
Not
many
singers
are
nomin
ated
for a
Gramy
Focus
Focus
Not
many
singers
are
nomin
ated
for a
Gramy
What’s
so
great
about
you is
that
you’re
no
C:
Yeah,
this is
my
third
album,
it’s
called
It’s
incredi
ble
becaus
e to be
nomin
ated
for a
What’s
so
great
about
you is
that
you’re
no
C:
Yeah,
this is
my
third
album,
it’s
called
It’s
incredi
ble
becaus
e to be
nomin
ated
for a
ズームアウト
CNN Headline News
Not many singers are
CNN Headline News
ズームアウト
Not many singers are
CNN Headline News
CNN Headline News
ズームアウト
CNN Headline News
ズームアウト
CNN Headline News
ズームアウト
ズームアウト
CNN Headline News
ズームアウト
Interview with Billy Gillman
ズームアウト
A: Not many singers are nominated for a Grammy for their very first
record but Billy Gillman did it before he was old enough to drive.
Laura Bolter reports.
B: What’s so great about you is that you’re no different from the first
time I met you before you’d sold over a million albums, this is your
third album
C: Yeah, this is my third album, it’s called daily dreaming. It’s just
been released in May 8 and I’m really proud of it. Making this album
was so much easier because I know what to do, I know what to say, if I
wanted to change something, I’d change it one weekend before we
started recording. Like every songwriter in Nashville got together in
my producers house. And they all got together in my producers house
CNN Headline News
ズームアウト
Interview with Billy Gillman
ズームアウト
A: Not many singers are nominated for a Grammy for their very first
record but Billy Gillman did it before he was old enough to drive.
Laura Bolter reports.
B: What’s so great about you is that you’re no different from the first
time I met you before you’d sold over a million albums, this is your
third album
C: Yeah, this is my third album, it’s called daily dreaming. It’s just
been released in May 8 and I’m really proud of it. Making this album
was so much easier because I know what to do, I know what to say, if I
wanted to change something, I’d change it one weekend before we
started recording. Like every songwriter in Nashville got together in
my producers house. And they all got together in my producers house
Focus
C: Yeah, this is my third album, it’s called daily dreaming. It’s just been
released in May 8 and I’m really proud of it. Making this album was so
much easier because I know what to do, I know what to say, if I wanted to
change something, I’d change it one weekend before we started recording.
Like every songwriter in Nashville got together in my producers house. And
they all got together in my producers house and they just made song after
song after song and we just picked 12 of them from a 50 album best. She’s
my girl is really funny because it’s not an acting concept like voice video
was when Oklahoma was released. I’m not staring, I don’t have to
concentrate so much. It’s a concert so we’re just having fun being my video
self, just having fun with the audience.
B: So you’re nominated for a Grammy this year.
C: Yes
B: Some people wait an entire lifetime for it.
C: It’s incredible because to be nominated for a Grammy is the pinnacle.
Like I said, it’s such a privilege, I’m at such an age where I love everything
minute of it just incase it ends. There’s nothing like the feeling of having
the audience smiling and listening to you. It gives you the most uplifting
feeling you can imagine.
C: Yeah, this is my third album, it’s called daily dreaming. It’s just been
released in May 8 and I’m really proud of it. Making this album was so
much easier because I know what to do, I know what to say, if I wanted to
change something, I’d change it one weekend before we started recording.
Like every songwriter in Nashville got together in my producers house. And
they all got together in my producers house and they just made song after
song after song and we just picked 12 of them from a 50 album best. She’s
my girl is really funny because it’s not an acting concept like voice video
was when Oklahoma was released. I’m not staring, I don’t have to
concentrate so much. It’s a concert so we’re just having fun being my video
self, just having fun with the audience.
Focus
B: So you’re nominated for a Grammy this year.
C: Yes
B: Some people wait an entire lifetime for it.
C: It’s incredible because to be nominated for a Grammy is the pinnacle.
Like I said, it’s such a privilege, I’m at such an age where I love everything
minute of it just incase it ends. There’s nothing like the feeling of having
the audience smiling and listening to you. It gives you the most uplifting
feeling you can imagine.
CNN Headline News
ズームアウト
Interview with Billy Gillman
ズームアウト
A: Not many singers are nominated for a Grammy for their very first
record but Billy Gillman did it before he was old enough to drive.
Laura Bolter reports.
B: What’s so great about you is that you’re no different from the first
time I met you before you’d sold over a million albums, this is your
third album
C: Yeah, this is my third album, it’s called daily dreaming. It’s just
been released in May 8 and I’m really proud of it. Making this album
was so much easier because I know what to do, I know what to say, if I
wanted to change something, I’d change it one weekend before we
started recording. Like every songwriter in Nashville got together in
my producers house. And they all got together in my producers house
CNN Headline News
ズームアウト
Interview with Billy Gillman
ズームイン
ズームアウト
A: Not many singers are nominated for a Grammy for their very first
record but Billy Gillman did it before he was old enough to drive.
Laura Bolter reports.
B: What’s so great about you is that you’re no different from the first
time I met you before you’d sold over a million albums, this is your
third album
C: Yeah, this is my third album, it’s called daily dreaming. It’s just
been released in May 8 and I’m really proud of it. Making this album
was so much easier because I know what to do, I know what to say, if I
wanted to change something, I’d change it one weekend before we
started recording. Like every songwriter in Nashville got together in
my producers house. And they all got together in my producers house
CNN Headline News
ズームアウト
CNN Headline News
ズームアウト
ズームイン
CNN Headline News
CNN Headline News
ズームイン
CNN Headline News
Not many singers are
CNN Headline News
ズームイン
Not many singers are