Communication apparatus, communication system, video image display control method, storage ...

39 Pages·2013·1.9 MB·English

US007231603B2
(12) United States Patent
(10) Patent N0.: US 7,231,603 B2
Matsumoto (45) Date of Patent: Jun. 12, 2007
(54) COMMUNICATION APPARATUS, 5,488,385 A * 1/1996 Singhal et a1. ............. .. 345/3.1
COMMUNICATION SYSTEM, VIDEO IMAGE 5,508,736 A * 4/1996 Cooper ..................... .. 348/144
DISPLAY CONTROL METHOD, STORAGE 5,537,153 A * 7/1996 Shigihara ................... .. 725/56
MEDIUM AND PROGRAM 5,579,239 A * 11/1996 Freeman et a1. .. 348/14.01
5,585,821 A * 12/1996 Ishikura et a1. ........... .. 715/856
(75) Inventor: Yuichi Matsumoto, KanagaWa (JP) 5,602,983 A * 2/1997 Naba et a1. ............... .. 345/501
5,606,336 A * 2/1997 Yuki . . 345/1.1
(73) Assigneei Canon Kabushiki Kaisha, Tokyo (JP) 5,648,824 A * 7/1997 Dunn et a1. ................. .. 725/88
5,652,845 A * 7/1997 Araiet a1. ................ .. 710/106
(*) Notice? subjectto any (11501211111911 the term Ofthis 5,673,079 A * 9/1997 Satoh ............. .. .. 348/14.1
132118913 11553511399670; 391115169 under 35 5,736,981 A * 4/1998 Nobutani et a1. ......... .. 345/574
. . . y ays.
21 A 1. N .: 10/165 320
( ) pp 0 ’ (Continued)
(65) Prior Publication Data US. Appl. No. 09/579,532, ?led on May 26, 2000.
US 2003/0001878 A1 Jan. 2, 2003 Primary Examineriwe?un LO
Assistant ExamineriSteVen B. Theriault
(30) Forelgn Apphcatlon Pnonty Data (74) Attorney, Agent, or Fi rmiFitZpatrick, Cella, Harper &
Jun. 14, 2001 (JP) ........................... .. 2001/180432 $011110
(51) Int. Cl. (57) ABSTRACT
H04N 5/45 (2006.01)
H04N 5/765 (2006.01) A _ _ f h _ _ h
(52) us. Cl. ................... .. 715/716; 348/14.08; 348/19; 00911111111890“ .apparams 0. t e PFeSen.‘ mvemlon as a
3 48 /5 6 4 functlon of dlsplaylng~ a plurahty of vldeo lmages on a same
(58) Field of Classi?cation Search .............. .. 715/720, We???‘ The .°°n.1mum°an°p.appa.ram Includes ?rst Syn'
thes1Z1ng umt W1th syntheslzlng vldeo data transmltted from
715/716, 856, 762; 348/14.15 - - - -
. . . a remote commumcatlon terrmnal and vldeo data on a local
See appl1cat1on ?le for complete search h1story. - - - - -
commumcatlon terrmnal so that a vldeo lmage on the remote
(56) References Cited communication terminal and a Video image on the local
communication terminal are displayed on the same screen in
US- PATENT DOCUMENTS accordance With display layout information common to the
4,742,350 A * 5/1988 K0 et a1. .................. .. 345/359 remo?e °°mmPni°ati°n_tennina1totheloFalcommuniPa?on
4,833,542 A * 5/l989 Hma et a1‘ 348683 terrmnal that 1s determlned based on a d1splay vldeo lmage
5 047 858 A * 9/1991 Aimonoya __ 3480181 number onthe remote communicationterrninalandadisplay
532583837 A * “H993 Gormley _ _ _ _ _ _ _ _ _ __ 348/441 Video image number on the local communication terminal,
5,258,839 A * “H993 Bae _ _ _ _ _ _ _ _ _ __ 348/473 and a d1splay umt Which displays vldeo lrnages correspond
5,305,100 A * 4/1994 Choi . . . . . . . . . . . . . . .. 348/159 mg to The syniheslzed Vldeo data Obtamed by the ?rst
5,375,068 A * 12/1994 Palmer et a1. ............ .. 709/204 syntheslzmg umt
5,408,247 A * 4/1995 Enomoto et a1. ......... .. 345/100
5,481,274 A * 1/1996 Aratani et a1. .............. .. 345/98 10 Claims, 23 Drawing Sheets
201
(I
1-1 2-1
1-2 1-3 2-2
US 7,231,603 B2
Page 2
US. PATENT DOCUMENTS 6,421,069 B1 * 7/2002 Ludtke et a1. ............ .. 715/762
6,441,841 B1* 8/2002 Tanoi .... .. .348/14.07
5,745,161 A * 4/1998 110 ........................ .. 348/14.09 6,456,334 131* 9/2002 Duhault ___________________ u 348/565
5757418 A * 5/1998 Inagaki - 348/1407 6,469,746 B1* 10/2002 Maida ...................... .. 348/564
5,764,277 A * 6/1998 Loui et a1. .. 348/14.01 6,496,860 132* 12/2002 Ludtke et al‘ 709/223
5,793,366 A * 8/1998 M11119 er a1 715/839 6,504,577 B1* 1/2003 V6112 et a1. ............... .. 348/448
5,805,118 A * 9/1998 Mishra er a1 345/11 6,535,240 B2* 3/2003 Yang @1211. ............ .. 348/14.08
5,825,432 A * 10/1998 YoneZaWa 348/563 6,538,703 131* 3/2003 Maeda et a1‘ 348/725
5,838,336 A * 11/1998 ROSS ----- -~ 345/536 6,630,913 B2* 10/2003 Lee .......................... .. 345/1.1
5,854,898 A * 12/1998 Riddle -~ ~709/231 6,646,647 B1* 11/2003 Surgutchik 61211. ....... .. 345/581
5,867,209 A * 2/1999 Irie er a1 348/1415 6,667,992 B1* 12/2003 Yanagawa ....... .. .370/490
5,887,147 A * 3/1999 Ami er a1 710/106 6,696,945 B1* 2/2004 Venetianer et a1. ....... .. 340/541
5,900,868 A * 5/1999 Duhault er a1 725/42 6,710,753 B2* 3/2004 Gillespie 61211. ........... .. 345/2.1
5,917,543 A * 6/1999 Uehara ........ .. 348/2119 6,714,172 B2 3/2004 Matsuzaki et a1‘ _ 345/11
5956081 A * 9/1999 Km er 91 348/163 6,714,238 B2* 3/2004 Urisaka et a1. ...... .. 348/211.99
5,956,094 A * 9/1999 Chun ------- -~ 348/564 6,754,178 B1* 6/2004 Sasaki ...................... .. 370/235
6,003,093 A * 12/1999 Kester 719/321 6,771,278 132* 8/2004 Shigeta _ 345/634
RE36,509 E * 1/2000 Shigihara . 348/564 6,816,129 131* l1/2004 Zimmerman _ 345711
6,028,585 A * 2/2000 181111 et a1. .. 345/581 6,833,874 132* 12/2004 Ozaki et a1‘ _ 348/565
6,057,888 A * 5/2000 Bril ............. .. 348/553 6911999 132* 6/2005 Sasaki ______ u _ 3418/2116
6,091,771 A * 7/2000 Seeley et a1. .. 375/240 6915347 132* 7/2005 709/227
6,118,493 A * 9/2000 Duhault et a1. 348/564 6941575 132* 9/2005 _ 725/105
6,137,490 A * 10/2000 ShiShidO ...... .. 345/690 6,943,845 132* 9/2005 348/555
6,160,544 A * 12/2000 Hayashi et a1. 715/716 7,003,795 132* 2/2006 _ 725/105
6,166,772 A * 12/2000 VOltZ et a1. 348/448 7,006,154 132* 2/2006 348/588
6,208,376 B1 * 3/2001 Tanaka et a1. . 348/153 7,031,391 B1 >1< 4/2006 375/240‘27
6,209,025 B1 * 3/2001 Bellamy ...... .. 709/217 7,176,957 132* 2/2007 Ivashin et a1‘ _ 348/14‘09
6,215,515 Bl* 4/2001 Wis 91 a1 348/1401 2001/0040532 A1* 11/2001 Yasuda ..... .. . 345/1.1
6,247,090 B1* 6/2001 Arai et a1. . . . . . . . . . . .. 710/9 gun/0051083 A1 5/2002 Armani et a1‘ 34g/554
6,262,713 Bl* 7/2001 Brusky er a1 345/158 2002/0067376 A1* 6/2002 Martin et a1. 345/810
6,275,852 Bl* 8/2001 Fllepp er a1 709/220 2002/0191071 A1* 12/2002 Rui et a1. 348/14.03
6,297,785 B1 * 10/2001 Sommer et a1. . . . . . . . . .. 345/1.1 2004/0l89623 A1>1< 9/2004 Dunn et al‘ N 345/204
6,313,853 Bl* 11/2001 Lamontagne 9M1‘ 715/762 2004/0227739 A1* 11/2004 Tani et a1. 345/173
6,332,139 B1* 12/2001 Kaneko 9ta1~ 707/6 2005/0255912 A1* 11/2005 Love 6131. ................. .. 463/30
6,335,722 B1* 1/2002 Tani e131. . . . . . . . . . . .. 345/173
6,380,972 B1 * 4/2002 Suga et a1. .......... .. 348/21199 * cited by examiner
U.S. Patent Jun. 12, 2007 Sheet 1 0f 23 US 7,231,603 B2
ar:
53:
4
O2
0m5m8229>;;>
aQQl20l::v, 5m:25M:325E2:Q%35)3 552955 E,E9:E:$ll22388e3 3 0
5N02.mO5:mOo7Mo3iwLv<5’ _e 5>: ; = ,a=23; :: 08
W~ 1 ‘< ::2735 Z2OE9N5"EE»E5Z 2 Q5 7= /\Tr>= w
:525:
AIAN.:2 :209:255s25 E355QQ2: @52 5 ::VA‘‘_ _ wN<
522%%;:::
__83o2z
.E26255m22m8m
M#iET=
U.S. Patent
Jun. 12, 2007 Sheet 2 0f 23 US 7,231,603 B2
FIG. 2
1-1 2-1
1-2 1-3
FIG. 3
(x15, Y1S)
(x15, Y1 E)
(x23, Y2S)
2-2
(X2E, Y2E)
U.S. Patent
Jun. 12, 2007 Sheet 3 0f 23 US 7,231,603 B2
FIG. 4
1-1
TV CAMERA 119 (A)
1-2 1-3
STB 111 (A) VCR 112(A)
FIG. 5
2-1
TV CAMERA 119 (B)
2-2
VCR 112(8)
U.S. Patent
Jun. 12, 2007 Sheet 4 0f 23 US 7,231,603 B2
FIG. 6
TV CAMERA 119 (A) TV CAMERA 119 (B)
STE 111 (A) VCR 112 (A) VCR 112 (B)
FIG. 7 3
1-1 2-3 2-1
1-2 1-3 2-2
U.S. Patent
Jun. 12, 2007 Sheet 5 0f 23 US 7,231,603 B2
FIG. 8
(xss, 1135) (X18, Y1 s)
2-3 2-1
(x35, Y3E) 011 E, Y1 E)
(X25, Y2S)
2-2
(X2E, Y2E)
FIG. 9
1-1
TV CAMERA
119 (A)
1-2 1-3
STB 111 (A) VCR 112 (A)
U.S. Patent
Jun. 12, 2007 Sheet 6 0f 23 US 7,231,603 B2
23 2-1
TV CAMERA
STB 111 (B) (19(8)
2-2
VCR 112(5)
TV CAMERA TV CAMERA
119(A) 3TB 111(5) 119(5)
STE 111 (A) VCR 112(A) VCR 112(5)
U.S. Patent Jun. 12, 2007 Sheet 7 0f 23 US 7,231,603 B2
H
552955mw E
525;2%%:; :::
35m:gM:255E:5255?V:5 ZOE2“N9E5"EEZ 5Q2 5
1Q020:,:V QAN..:25vW 9 :2520E“525:52Qw 55i3w 2 5:: : :‘= < w<N 255%A\% m8w02%a5;s,)> : A#A#:Hm:22$253522y:8 0 : 0 =Qm2m=: :V 8322 5
QE9E,: \
W~ “4 8NAD_m85.:<om3\9<oV(Vs< 9> _ = 2> _ /\VVV>
:2:23: 7>
A
U.S. Patent Jun. 12, 2007 Sheet 8 0f 23 US 7,231,603 B2
FIG. 13
301
S
1-1 2-2
2-1
1-2 1-3
FIG. 14
M 2-2
(X28, Y2S)
(XME, YME)