Free Declaration - District Court of Delaware - Delaware

Case 1:07-cv-00787-SLR

Document 77

Filed 05/16/2008

Page 1 of 3

IN THE UNITED STATES DISTRICT COURT FOR THE DISTRICT OF DELAWARE

) ) Plaintiff, ) ) v. ) ) ) AMAZON WEB SERVICES LLC, ) AMAZON.COM, INC., ALEXA ) INTERNET, INC., IAC SEARCH & ) MEDIA, INC., SNAP TECHNOLOGIES, ) INC., YAHOO!, INC., EXALEAD S.A., ) and EXALEAD, INC., ) ) Defendants. ) ) GIRAFA.COM, INC.,

C.A. NO. 07-787 (SLR)

DECLARATION OF MARK D. NIELSEN IN OPPOSITION TO GIRAFA.COMS MOTION FOR PRELIMINARY INJUNCTION I, Mark D. Nielsen, declare: 1. I am an attorney licensed to practice in the States of California and Texas and

before the United States Courts of Appeals for the Ninth and Federal Circuits, as well as the Central, Eastern, Northern, and Southern Districts of California, and Northern and Southern District of Texas. I am also licensed to practice before the United States Patent and Trademark Office. I am admitted pro hac vice before this Court for this case. I am a partner in the law firm of Cislo & Thomas LLP representing Plaintiff Snap Technologies, Inc. (Snap). I make this declaration of my own personal knowledge or on information and belief where so stated. If called as a witness, I could and would competently testify to the truth of the matters asserted herein. 1

Case 1:07-cv-00787-SLR

Document 77

Filed 05/16/2008

Page 2 of 3

2.

The letter order of the exhibits in this declaration begins at Exhibit B to avoid

confusion with the concurrently submitted Agostino Declaration, which contains an Exhibit A. 3. Attached hereto as Exhibit B is a true and correct copy of an article entitled This article was

Web Representation with Dynamic Thumbnails by Stephan Schmid.

published in March of 1998, as indicated in other patent documents, such as United States Patent 6,301,607. 4. Attached hereto as Exhibit C is a true and correct copy of United States Patent

7,177,948 to Kraft. 5. Attached hereto as Exhibit D is a true and correct copy of United States Patent

6,496,206 to Mernyk. 6. Attached hereto as Exhibit E is a true and correct copy of United States Patent

6,594,697 to Praitis. 7. Attached hereto as Exhibit F is a true and correct copy of an article entitled

Visual preview for link traversal on the World Wide Web by Theodorich Kopetzky and Max Muhlhauser. This article was published in May of 1999 as indicated at the URL

http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6VRG-405TDWC15&_user=10&_rdoc=1&_fmt=&_orig=search&_sort=d&view=c&_acct=C000050221&_ version=1&_urlVersion=0&_userid=10&md5=e97180017d913c62f65cf18e15f12322. 8. Attached hereto as Exhibit G is a true and correct copy of United States Patent

6,108,703 to Leighton. 9. Attached hereto as Exhibit H is a true and correct copy of United States Patent

5,991,809 to Kriegsman.

2

Case 1:07-cv-00787-SLR

Document 77

Filed 05/16/2008

Page 3 of 3

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 1 of 108

EXHIBIT B

¢ ! W! U ¢ ¢ © ! R S ¤ © ¢ ÿ þ ! R 6 ¤ & ¢ ¢ H © ¢ ! ý ¥þ ¡"¡8VQP"¡¡CT¡P¥¡w"£(7(Q¥£PIþ 7&G ¢ ¡ 9 "£¦F ¡¡ÿ E"P(CB8"! £¡87§5"3¡21"('£$"S"§ ¥¨§"¥£¡¶"uü &) ÿ ! ¤ 9 D! þ & A@ ¤ 9 6 4 ! & © © 0)! & % # þ ¤ þ ©! © © ¢ © ¢ ¦ þ ¤ ¢ ÿ þ ý Âw yRG G TIG TvV sv ûw as R R G a a  ÂI g Å a sI qq I tYlHquHU7U£uIP7I ¼ ruusdTr¼ UH7dIHP7hv T R s I c R Is I XG I a ¼ G R XG w I ¼ R p y I ½ vG c p p R T I Q v Is R I X à  a X p R s ¼ I aw Q R I c R T Å v t7WUqPBWPUdUtruUtfú7¾CuÄqdI a Wtæqu¦GtbPt¾7WzUdVrWtYUq»u¢Á d BUdÙ a UH v hhc I XG ¼ a I c G v X a Å GwIsIG a ùsI c RIs I XG GV RsGGR vG Å a Is R `w R w Åv X aR T y ` XG ô  c R WPCWdTH R WbWuGhxqP7PdT4w 7qPzWP&PPxtÄuøqI7PWp xhWuw trrWu÷© v RG R c I V c Is vG c T R I aG c R T Å v c T IGs v Xw vG a R ` a R T y ` XG Iw ws I T aw I c y I ½ g s RQ v PtW27rqPPârtb`PÄU v hhæquuUWuÄP¾ dTt w trrWuzxf4Y7W¼uq¯7¾tSF  a X p R s ¼ I aw Q I XG Å a vG Is G a a ` I XG T v Ù V T R V s I c R Is I X à  Is G a p R Q UdVWrtYU7d»u¢Á Wuö7dIHPuWPhÀRWdTruUBYÀV a t7hqUuWuru&ÀVWUv G TIG T vV I XG Q v Å a Is p Ù a ¿ R I a vs p I XG g I ¼ R a sI ¼s R Q v T aG RG TIw Is pI R `w R w ô Âó ò Is H7uH"WP¥UõqIquWzYdVWHÀchuW7ruUtd`lqUPt R (U2vPhYqxur7Ps xb¨£¢&ìBuWPG Á a R a as v I ¼s I XG vG G a v p G R XG w I ¼ R a I awÁ c IV c Is c T R c IsI c TIsÁIs p Is R a R T y ` XG aG RG "dVWp fT¼PUUPt R WuPHdTU4hrP£qUU`7d»x"ruÄrUqP7Wr7P¶7urPt w UrWWudVPhYHF

E ¢ 3 A ' 8 6 "q4CñCB@97(( ð

ï

wI¼Rp cIÙ Q qUUrqWT a Uv G v c T R G T IG T v V XG v y T v T aG R `s vQ a a R G T v V a R T y ` XG X a Å s I XG I ¼ vG w Ù R G å I Ã î ì Is U R rthH7P"uUf2UzvPhPUdTzdTtY" w UrWrHPzPqGhqWu7UUPrTa ¨ rPH7ªPWUd¼a í
Information about Content: yes Layout: no Information about Content: little Layout: yes Information about Content: yes Layout: yes

 p ` R å I T R w R ì Is ¼ ë I I F  G v c T R G T IG T v V ¼ a c s R ¼ Is T aG R `s vQ a Q v ` a å R ` I bU72UhUburUr7U R rUquHU7WdTYtH7P2vPhudTUêWd`hR I a I Vs I p R ` s Iw I XG w I a T X V IG XG v y ¼ a a y ` v é  G T IG T v V I XG c T R G v I ¼ R p I XG Q v T aG R `s vQ Ud77Pqfb7ur¨WP(qrÀ¿WWYuPtWdTWTrUqHquHU7£WPftU R UtfWu¨UvPhPUdTa TUPHU7Uträ7¾æ"rquq"Pru¨U2PWPhÀRWTb¾PH7uqPW7PUtd`Wu2uqWhqWdTa trWWà a RG T v V g I ¼ R p y I ½ c I V T Is IQ Is I XG Q v Is G a a ` R wG T Iw Is p Is I ¼ R a I XG Is I X Å g w Ù a R T y ` X ÂqHquHU7UUrWPBfUèUdvuhPUdTCUdUä rxfh7uWYV 4QhqrT a ¶uH7ªçqWT a xqfX G T IG T v V I ¼ R p I XG G v y R T aG R `s vQ a I a ¼ R w g T Iw v X I Å a g w Ù T vÁG åI à  w Ù Ás I p Qtævuuur7£UqhWu2UhPWbd`ÄPxqUWuCvPhYqxur7PäqÄ"ftrWqâu7YUäT ã v T awwIs p åI Q v sI Åv p I XG I vs p a vG GwI ¼ ¼ w I Å g T aGRG TIwIs pIs yI ½ IV TR X TI vG sI cs v ÂwsIw Åvs y yI qPqxhPW7¾½ y wsIw vG cIG TIwIs p Is R yI ½ I XG Q v w RIs R ` F ÂwI c v T TII ÅGI y T aGVI T T vVsIG a w R wI ¼ R p yI £Pqxf2PCqPH7uqPWPtâ7¾Wut£UqPtR d qqWrÄq7l"Udvu"qWW"Y7PdTUqtr¾7¾½ Î Ý Ô ÜÛ Ú cI ` R T gw Ù ÁsI p X c T R w I c v T w Ø × Ö Õ Ë ÊÔ ÓÑ Ò ÑË Ð ÏÎ sI XGv vG á à ß Þ Ï Ñ 7rutug ¨Í Ú &Î Ç Î Ë Î É £Í Ô uÎ &Ë Î PqbtfqWT a xqfrUWR ¥£ ¨t¢tPÊ Î PhÊ &£Í ÌËÊ È Ç Æ c RV wwIs c c R I a T w a w R X X a X Å Qv XV RIgwI¼R p yI ½ Qv IsI ` wG aw TvV yI ½ I X à ÂwI a &t"É r¾qI 7ªPqPWWHÀ¿WW¥PGªr4YÀVWhWtYq7UUrqÄWU£ P7bYÀwurU77¾r¥qqWHÀ¿WT Á XVIG T aGRG TIwIs pIs cIGR aG a X p vw wI a ¿Is yI ½ I XG Qv ¼ v p vG cIs GV sGw cs R X I XG ¼ a R YuBvPhYqxur7PzuhqdVPÀwWWxudsWHqP7¾WutU v UuzqPWP&rPuxB PUrWuWdT7d» a rudwa º ! 6 A ¹ ! © "lBb ¸ · j j it s mr s i v s s s µrj n p j op n s tp i rYl Hu&hujuoH4¶tqPq£t &PHYYu´usqHuU"t j£ xrjt s rj n j p ³ ² ± ° p m i j st p o k k p p ® s o st jt m k rj sj j j£ p i j p j Pq¦putuPYqSWb£¯&HHfqum7&u£usHqb7YYujtqs7qptPqPuYYYH7YHqY j it t jjr kjr mt vp j j km sp n it jtprj j op s p v p j s mr k j o jp k j v p x H©hYYUYlY(uH Yq¨uuoqUY7xPY¨vuoq&u£qHUUHq£&qt"HuusHl¥YPqHY£h7Wqm quo7H£Ht¥"HwqUH(Ut"l(Yu£UuHuusHUY"lq(qYY74u©hYH74PWqHqum7xtuqsHlt s p n it jt p mt k n j s mr k mt j s rj j o m o j m p j m k mr k j j p s t j p rj k x m st p s o j it m j n ¬ j n s i£jt j v o k j p s jp k j xm st ojr t jjr kjr mt jp k j xm §jp s op ¤ sp n i HHhq«HuPhYh&qmY¨qªu©Y7¨YqHqqm"qpY¨hYYUY¨YqqH£YqxPq4uhuoq4¦¥uqo7Htt u£"x¢Hulh7umqY HqCqqm"xhYYP2qY(v47P&Y2hYPHYtHuuswuhi st pt s ¡ v o m k mt j j it x m st pt jjr kjr pj o m jr p rj mr j v jrj jr orj k v j j j i s jp k j vp m g vp vrj j j sj jrp jp k j j xm p nm i g orm j it rj &UH&£YtPqHbYHhYHthYHPPb&HqqP¨7Y7bPPH7Uq(rqqHP"m uoqYt4Yf7&qqH7x¨&uj(qH7Ybh2u~uqbzHrq4wut"qpHHql(htWh7q(B o p j s j x m it mr s k pr mt o p i y y y y ~ y }| { y j it x m v sr o n k m k j i g f e d TR `sI g Qv awsI a tP7` tBGxY7rT gw `IGw F cIG asG Q v G TI `Gs R p 77PuryPuxdwa i UH7buutrqI i g e a ` XV F T RQ IG hfdcbWYWCUS"PHF E ¢ 3 A ' 8 6 3 0 ) ' # ! ¡ ¡ © § ¡ ¤ ¢ "74CDCB@975421¥(&%$"¨¨¦¥£¡
Document 77-2 Filed 05/16/2008 Page 2 of 108

Case 1:07-cv-00787-SLR

Text

vs Thumbnail

vs Text & Thumbnail



 `IGw w T aGR a T ` ` vV wwIV vs psIG 7uxxUdvut7ÀVWW"Pq"PWP7uHdTa Ø Y i CUrtrYWsPhR i ÀVbtr i w ¦GtuP"ÀVa I HÄqI d PuHU7¾ Ptb7PÀw47uhurBWUWdTUWqWdTa i Õ I¼ TR XV å Y RG a `RT ù Qvw vs y c vsG TvV IGv `Is a sIw Åvs y I X à ÂI a¼ TI ¼ ÁsI c TIs w R Gw v X sI sIw I X T c RGw a T awsI I p RVwGI U G TIss V I XG wIw T aGRG TI ` p a s u7rquBU2xWqUP7uÄWPG Uv I d YrdTäUdvxY7fU7PP7H7Pur"Äruxf UdvuhYH7b7 I b`zW£S
~ 0 ~ q } )e%zTVue|{ y n j p w e p g u n s r q n p e g o n l k j i g f f e d zx @5ii)vt s yg )4yXf h)i)XT4@m)rh Xhi X©Xy))iX §¨ c©§

î w Å vQ w R 7hv UÀwa Ø UdvutPtrT í U ¡ dT¾hPHuhxqrus PqW7rqxqWHqPt ò T aGRGv Y aÕ å RG T w Gw I ¿ I Rs I T I ¼ I X à  Gw I ¿ Is ó à Y Á P à à T R w R c I c v V T I a Gw I ¿ Is X V R Y  G T p ` v V P à à I y vG c I T aw I c a G R `s vQ Gw I ¿ Is I X h£WUzqW7r7lÀwxqWHuBYVqHtÀR a bU"äh¨PbqW¼uqWlÀwhuxqWHuWà ÂsI sIw I XG wwIVV R vG c Iw I y T RV  VGI wG I sIw gwG asVw a ¼V gw aÁ ¼ p sIw Å vs y gw ` Rs ¼ vs p R R H w qqUP7u4WuPq77UBPBxfftqtP7P7 I UP7uqPWpP"P¢ÁU7W7fT¢tW 7uhPWqtYUuWhR XV w w ` Rs ¼ vs p G T V cIG TI ` p a Iw g I aGR TsI ô ÂG T V R w R cI a ¿Is a sIw Åvs y yI ½ R IsI YrxUPUPWH7dI a qPqb7 I b`¢¦Á Q xHU PhrP7P G (H7dI a UbudsWHqPÀw7uhuWz7¾ P7b` Á s Rww IV I T w aÁ ¼ p s Iw Å vs yI ½ s v T w T aG R p p R G T V V aV I pw Is R s I X aI U  w I ¼ R y I ½ vG ¾PtPu"qrrdT¶UW qxhPWy 7¾UWbfUdvuhqdV a WUzH7dI a që7qxCPtzqWuG7¨%qqtrp qÄâuHdTa w UrWWubuhY7r7Ub 7ÀVbtruhYUquHdT bd`xbubGWWPxfrUWuPqiltr¢t bXé Ö a R T y ` XG c IG RsI TI ¼ R a ` R T c IG Rs ¼IG a p aw vG a T Gs v p p v I XG wsI ¤ v G R X à Âó ò a ì R í vG ¼ a cs v V V R s Iw Å vs y y I ½ I X ` vsQ G V I a c a R T y ` XG Gw I ¿ Is vG w s Iw w Å uWTWP"7¥qxhPWqÄWPG UP &qPds( w trrWu¥WHqP£PY7ur¥hv d R 7PtPWÄh¨©Wà vV vGvs p P à à I X Âq w tfWWPhUUrB7¾t(UP"H ¨ ã 144à ã Hg £ UBYfxY7P"btYtfWHqP£ru"UYu"4PG a R T y ` XG I ¼ R p yI ½ Q v  VGI g à Y g i ½ × Ö w R XV w wsIGI ` Rs R p GwI ¿Is I XG GV RsG åI v cIws R p Is R wGwI ¿Is G T V ¼ a ` vV ÂwG T V w a ¼ a cs R ¼Is sI sIw P à à R I wGV R sI sIw I X quPUr4Pt¨YWHqP£H7dI a 2rTbU7rT ã qPHqI a PGWdTPUqu£7UP7uèh£Ù a Y&£7uqxWà  "uUur2vPh7ÀVWWbU"hR vV vGvs p T aGR a T ` `vV w á @QuÚ Þ yY¢tulxË Î É Ï tuvÔ uÎ uË Î P4WPxfhrUdvut7ÀV a Wt¨H7dI a WPrtqUP7F UrWW4Wà w 7 7 C ÊÑ ÊÔ ÊË w ÇÓË 7 Ý 7 ÜÛ Ú I XG Iw w T aGR p pR G T V I XG c TR sI sI a R T y ` X à I X
! t & t 2 t q 2 0! h g f £@©4")sr£3pi4e`4e©d b¨ c©§

 P é vV vGvs p GI TsIG I XG a sIsI aR T y ` X à I XG wwIVV (P ã R©Q¨Ã 7PtPWh"WP7PHT ã WuÀRHhqUP7F tfWW4WPu"7R I g7`UPsUPsWWU v RcrUPxwB7WXPtvBvlg¢ó wtRYUUPWp ×1Ö£º 7YG" I WU¾hH£qPqxhPWy qÄæPtfTYUbR w R ¼v p I T Á TRG sI G s ò ` s¼vs gw p p R RR H gwsIw Åvs yI ½ sR a cs v w X gw T YVrxwqPGH7dI a é c`7UPs7uÁxH7Id a RzcquUfyÀwa Î SFGË Î E@DCÈh¨"ABÌ@8WuªtPWu"qPqGWYYtR Y7WqU£Wà I v sI Iw G T V T v IwR ÑÈ Ó Ç Ð 9 7 I XG Qv Is GVI a XVs RsI TI¼ I X 6 5431)'%$" ©§ 2 & 20 ( & # ! ¨

 cIG IssIG a IsR w a åvs ©uh R PP7uHdT£PtIPWp sv wsIsIw yI ½ c TR gI a ¼ TI ¼ asI c TIs I XG gsIsI aR T y ` X à I XG gwG T U¨PqUP7uÄqÄrt©UrTW72WTP7Wr7PruqqUP7F trWWru¨qPH7dI a V hW£hWxw PW¼a í Åv X w Åv X Is  s I p R Q I XG a c I a p å I a Is c I V vs p a X à  w v I T R a qqfUrp d WP2dTqWdTt R "Àw urq7PWÀwWU fU7rtP G `uw w UrWWuu"PWâu I trU7bxrqUP7uWuqPH7dI a I pP G âuâ H7Pur"r" w UrWrHPG a R T y ` XG wwIV vs p vG yR p RV I y Gw ` sI sIw I XG gwG T V a ` vG G TIss V T vV a R T y ` X I a vs p vG sI cs v ÀcHhPW¾u7WP¯T ã qH7dI a CWu¾Pâ quädTbHqxärtqrYU7w qqUP7uruäTqPUPbÀwa UrWrHPG ÂG T V I XG vG pIs a G TIw c T R wI XV RV ùsI sIw I XG a cIs vGw a R T y ` X cIG RsI TI ¼ ÅI T I X à Âó ò Y P H vG ¼ a cs vVV R c I c vV TI a I ¼ R a I XG gw cs R ÅsI Q ô  Gw I ¿Is G T V I X qutPqW7ç7WW£¢a %`XWPbWdTP"qU"rq¨Àw4UU`Wuf7rPUlP7P¦Gh¨WHqP£H7dI a WPG Qv G X aI X c T R XG a Å vG ¼ a cs vVV R pR ` a y I XG w RVw c TR I ¼R a cIsI c TIs I XG wIs G p RV sI sIw I X tHUd¼7W¾rUâPÀchCu2WTWP"7útuGWBWP£q I 7Pârtt`ÄqP7Wr7PWuuruU77uqxBWPG g T I X à  I ¼ R p I XG s I c T Is v I p R Vw G I U   IÕ s Iw Å vs y y I ½ ¼ aG a å I T R Iw I Å g T aG RG T I ` p a s v qW(UUUr¨ruqr7P4PG Ø tquY"¨Vf¼ qxhPWBqÄ4rTPÀw"t£xr¨HUdvutPH7bq I bd`WT ã Âqu"ur¨7Wr7PWPUqIrYUzPhl I dyuuHfp Y7Uqx4PtuqW¨Utd`WPhY7f7PCrtUtf7¾½ wwIV vs p sI c TIs I XG I a XV R vG w R Å aww v RsI Iw IsR IsI X à  I ¼R a I XG wsI c TIs c TR I ¼R p yI cIGwI ¿Is I XG w c R sI sIw I XGg I a ÅsI XG S ÂG T V I XG vG ÙV R y G TIw IG a cI ` a a ag cI a p åI G v T c T quxqrulWPW v qUP7uruUudwhP7ru¨TqH7dI a lru£uYUr(H7u4 utdRbd`dw(Gh©qPsr7UWrUR cIsI c TIs c RI R a R T y ` XG I ¼R p yI ½ cIGwI ¿Is I XG ÂwI XV RV Ù a c c TR s v `I ` w a w ÙVI XV Gws qP7rquqP s lÀwa UrWWutr27¾BuxqWHqPWuQ ã qqWY7Budw2rtPUb7blPGYWYlxYrë sI sIw I XG g cI aIVIs a GwI ¿Is I XG sI Q ô ÂwI ¼ R p yI ½ s Rs a ys R Q v a R T y ` XG wGwI ¿Is G T 7uqxru©Ud77qPhdwxqruWu¨7u¦GqqtrCqÄPtYuGWPtth w trWWuYWHqP¨H7dI a V ô

 a R T y ` XG s v s vQ w I V s vw w ` I XG Iw v X V I Å g ws I s Iw y I ½ X ¼ vs XG aww I V V R I T v Is q w UrWrHPWUhq"YWxhR 7ruxHWYqPqUP7uC7¾2WUPWu£ I yuPq"qU4WdT a UuUR w I ¼ R p y I ½ s I v Is v ` c T ì Is ¼ ë I IwÕ T aG RG T Iw Is p Is Ù Ás I p X I V T R X T I a R T y ` XG I ¼ R p y I qtr¾7¾7UhqubrUR Ø uWr7uSäUdvuhYH7uqPW7PCWdT a xqfb"rUrWq w trrWutr¾7¾½ IV a F  T aGRG TIwIs pI R a as v I XG Qv wIVs vw awwIVV R I T v wI a ¿Is R a `R T c aR T y ` XG ¼ "fT(UdvutPH7uqPWqus rdTUd¼u£ru©tq7PWx I yuu"qU£rT a UqPsrub 7ÀVbtrl w tfWWP4WdTa ÁGRsI TI ÂwI ¼ R p yI ½ Qv wI ¼ R a cIsI c TIs c T R `I c T v c TR cI a vs p I T v IsR aR T y ` XG a `R T xtPqW7qqUUr7¾tqUU`qP7Wr7PrUbqBUbftbqÀchurWdT a Pt w trWWuÀVbtr i E ¢ 3 A ' 8 6 3 0 774CDCB@9" 421)
¦

 a R T y ` XG aGRGw Q v w T aGR a I XG I ` vVsI v v 7 w trWWu£ÀVuhYtfUdvuhYqGbd` a ru£"Y7hPG Gs v ¤I T ¢ a R T y ` XG a ` R T c Iw v p vs p I Å g T aGVIw G åI T I XG  I c R `ÁIs I y vG I R X a R T y ` X uU¨¥tR £ w UrWWu£dVbUrxHfuW lUdvu"qu¨"WWPT ã U¢"PfbP£r w UrWrHPG g©UWUrYuUBqtrWTPÀw"Bv qf7u7CuUzqPqGuöqÄèqWX ½ ©qPhWYUv qu¦GUCuUz w UrWrHPG cI¼ TR XV IsR wI ¼R p ¼ aG a åI s cI c TIG åI IsR wI aw yI ½ TI  cIGR cG TI Qv IsR aR T y ` X ÀVuhYU r"q2U rt qtd`a trTWUqb¾rtWdTU v UPhqP"Puz I UWrqf"4dw4Ga aGRGw g c T vVI F  R T R ` wI ¼ R Q ¼ a T R I ` c T R ¼ a Ù v Á c v v ¼ IG R Is V vG Ùs v Å y R c T I p å I a g UxPdsa í qP"qxbPhH7Wr PWuÄ7ru7 w trWWuÀVutPxhU qtPHUWUzWP qWdcuqI ¡ R Q v Gw ÂwGVI pw R I aGR ¼I T I R X Is w I XG g aR T y ` XG aGRGw Q v wI ¼RG T R c R I XG wI aw  w a R sGw T v V XG a Å c T R y v T Is R Is I XG a w a X p Rs ¼ X a Å w I ¼ R p y I ½ s IQ Is p R w ws I c R  w I ¼ R qrdTtYuxrU7PÀchrtfrPtP7WP¥Ql7ÀVWWUPPqGhUUr7¾h7"PWB d rurlPqUI Ö 7UUrp ds7WPUUd¼uqBWP7rtfW7u w trWWurt Utd`urâ7P¦Gt£PqWUd¼uqú7¾©UPUbP7WPxr í aI XG Q v T awI c I XG IV TR X TI vG aR T y ` XG c TR wI ¼R a Iw TI Qv wsI T awI c yI ½ g Is v `sI XGs
Case 1:07-cv-00787-SLR Document 77-2 Filed 05/16/2008 Page 3 of 108



W R ¢ þ @ ¢ ¢ & © ¢ þ ¢ © H A W ¢ S W R ¢ & ¢ þ ¢ A ¢) R A ¢ Q ¢ ¡A ¥ 3Q¡(¨$¡ICA C5R ¢ S3© ¡£¥ ¡¨H "¡C27P H & A HA W A H H HH Rþþ þ IC¥ 9 ¥¡C 9 I¨$CH 0 S7¨P ¢) W )! G ¢ ¤ A! þ & A@ ¤ ¢ E 9 ¢ ¤! & S A R ¢ © ¢ @ ¢ © ¢ ¦ © ! þ & ¢) B @ 8 % ¢ þ ¤ þ 6 A "¡ "&I C"P(CB8"! CA FC¡"") CC¡3¥QD¥I'CA @ "P("¥¢ CA9¨¡"! ¢ 7£R "! $ 4A 42 © H A 5 3 ÂqqUUrp 7¾½ q7r7P77ut2WUU R ftCquHU7UUWq I hWBw qqUuâWPuUqP"fTWdTa ru"PG w I ¼ R y I c I V T Is IQ Is Q v G v c T R G T IG T v V Q v I ¼ c Å v T Ù ù s I c R Is I XG Iw R Is V a w Ù R G å I X a Å T aG IssIG a a aR T y ` XG I ¼ R p yI ½ GR XG cIww V a c I R X I ½ ÂwsI T awI c yI ½ y I a T XVI uGhUdvut R uP7PHTÄT£ w tfWWP4UUrqÄ hfuxPr"PÀwUf¾£qY7W¼uq¾7¾CWHÀ¿WWYqPG cIw T v ` ` vV R c RI R a 0 ¼ a R T y ` XG( gw a X p Rs ¼ I ¼s sI XG v c T R wI ¼ R p yI ½ ¼ aG TIwIs p qur¾ b"âqP s ÀwC1WdT a UrWrHP)7qdVrWtYUBuU R 7WPtârUUtfæ7¾WdTuH7uqPWqI Ö

0 © ( 3 CA ð 3
'

 a R T y ` XG I ¼ R p y I ½ I XG ¼ aw I V RQs IG a s Iw × I Ö Å v v é I X q w trrWu£UUr7¾WubrTur "SxquHThqxf £º hPs ¡ WPG Qttrx7qu7uhYqxurp uW¼a í qrvUbtqqqtrCqÄPtYuGWPtth w UrWWuzqutPqW7¼ v Gv Xw TIIsVw R wG TIwIs Is Âw a y v I `RVI y wI ¼R p yI ½ sRs a ysR Qv a R T y ` XG cIGRsI TI 7ÀVbtr qWdchPWâYdVWhb7dVP7uw 7rU7WW2¶ó ò Ø vPh7 v w 7urBWPtqr qUUrâ7¾½ R a `R T c wI a vs p X a X Å I a sI ÅI T R Qv cII T I X à  T aGRV ùsIw I XG sRI T wI¼R p yI ¼ aG T Iw Is p IsÕ a R T y ` XG I ¼ R p y I ½ c T w s v y X a I T ¼ aG T Iw Is p IsÕ w T v a s Iw Q v ¼ aG aw T v V w I ¼ R WdTuH7uqPW7Pb w UrWWu4tr¾7¾ftR Ø YUUd¼7W2WTPH7uqPW7PrU7dV qxrtWTPÀwurU7£Utd`a Qt¾7l2urul¾Udvu uWb7WqP7urWPtrWPuÄqWT a u v qtrâ7¾WPrUR v yI Å R Iw vG w R Å T aG vw I X à Âw c RIs sIw I XG I ¼R p I XG vG cI Ù Iw V wI ¼R p yI ½ I XG c T % w s v y X ¼a I T ù s I w I X G T R I ` I Å g Ga Ta Va ù s I w R G v y R ¼ Ta R à  y I ½ I X G ¼ Ta w Å v s y a X Å Ga Ta Va &YUUd7W£w qqxrWPCt©qr7d£w 7urB UtWdH Ù 4qÄWuBWuhPW I WhqWd"À w qqxrUÄvPhPHqxuWquúqqWl¥&q$ur#hPs ¡ rut¾vP7H7bW v UqzWPWTPW i ùsIw R Q v T aGRG TIwIs pIs R cI cII T I Å gGVI¡ vs p " Åv v é I XG Q v c asI p G TI ` p I I c I XG ¼ as # ! © ! ! ¡ 6 © ¡ £ê!@9ht( ¸ 1 © ¡
¤ ¨ ¡ ' 1©ø8 ¦ ! 6 E § §7(h"qCC§ ¥


¥

¤

 c R y sv c v v ¢ I¼R p yI ½ I XG wI aIVsI ©rU2H¼ UUr7¾Wuqq"Y7p UbbU7¥Y7urUdÙ a U v w trrWuWP©PdsWP4r¨¥WTW7£WdTuqr7PWU(f£Uur¥UWlÅ T v ` ` vV wsIw I Ù v a R T y ` XG I XGg c a XG c T ô  I a ¼ TI ¼ asI c TIs s v Gw ¡c R vG I R X G v T v c I g©f v U7WuUR Ø Y7 R qqbtYhr¼ USuruhQ I £ 7W£hrh7Pxh21WTW7rTP7f7P4UUrp c I p I I c Is w s I g w I ` R sQ   IÕ w Is G R I × Ã Å I T G R X Å s IGG R ` v U  I a ¼ T I ¼ as I c T Is I ¼ R yI ½ IG R cÁ vGÁ p T R I R X w R R I Å g I p RVwGI U w R XV w s Iw Å vs y y I ½ s v¡ R ` R ¼ vsG T vV IG v `Is v 7¾ uhr¢Uu¶Wt Url Å lWfU7PP"¨UCYrulqxhPWCqÄU¢WdTa uP"uUb7PPG I c g c T vVI F  I a ¼ TI ¼ asI c TIs R ¼ aG TI ` p aÁIs Q v I aG y RsI aw T vV cI Rw I Å gGw  T aG asGwI WWrU7qWTW7WdTuqrquWTPH7b7 I b`¢"P¥Ub`P¨ I tY7WdcurU7BqulWqxYsa í Udvu"dVPuxqPs ÀwWuæuGhUd a PrUuUu¾UPtzP7ruUUPHthuÀwÀwWPlUBuGWuæT ã qrvPh7ÀV a Wt¾xUrâYsWPG a XG X a Å I vG w T vw RIs c v v ¼ Is R IsI XG g I ¼ RG T R c R a c a XG Q v I a pw Âw T aGR p p R Gs R p c a X T v w c TI pI c Is R Å Q vw I XG GR XG w p a I a ¼ TI ¼ asI c TIs R w R sIw Åvs y yI R TsIG åI T R ¼ a UWrqfqBuUl¦GUxWuhfuqdI a bd`BWdTUWqWdTuqrquU7uhuW7¾½ fuqu"æUÄWdTuw Is GVI a XVs ô sIsI aR T y ` X à Is uWP&uGWYP¨h7UP7F UrWrHî uW¼a í

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 4 of 108



Document Base

HTTP Server

Web Server Host

Port: 80

Client Host
File-Cache Memory-Cache Cache Concurrency Control Thumbnail Server

Web-Browser
Machine State Request Port: 4444 Communication Interface DDE Interface

Thumbnail Server Host

Cache

VRML-User-Interface

Web Server Host

HTTP Proxy

Client Host
DDE Netscape Rendering Engine Port: 80

Âì  à T aGR c TI ` `vV à é UWa Udvuhrr7bbU7qI Ö hà ã hé á i gÞ Ï Ó Ì ÈÔ Ç ÊÔ Ð Ê Ð ÈÔ Ç Ê ÉÊ È § Ê § Ç Ó Ç Ê ÏÏ Ë Ü Ì Ê C Ó È È b  ìÁ a ì ` ì ã S ó g 4ß w h"Î 0b"DCDCwE Î h( Ï hrr¦Ç¶rtfxz ¦Çt0e©tÄhSÈ Y"Î ¨hdy¦ÔtcTdgUYh'Wi'F £i )F ã a ò uHX Xi USxhSuU7V qus hhhR PxHWî ¨ h4WdT a UHWh R I tYXV8@QuÚ `G  a ì VQs R VQs R ` v  T I å v  ŠŠŠR î pGG X × Ö î G R I T v g ì g W G F w 7 7 ! C ÊÑ ÊÔ ÊË UyY¢tulw Ë Î ÏÉ huW7 Ô PÎ &Ë Î P4Ú TR0I¨© ¨Í ¨xPs í 4 fWTW c Ia í Â Ö UqI × Y7ruqI ¡ 4t ò ÇÓË Ý Ô ÜÛ S Q PH G F à g Ù Gw  g ¼ a g I ÁwsI Ts  à ó 2 h g EDCÎ 9 ¦ÇÈ "Î wȦÔf¦Ç"SÑÈ # ì B B B Ô Ï È È Î Ó Í 7 g w w I X X V F  P g a I X » a v  5 g s c  F g X V a T 3v  ( Î Æ ÉÊ Ç ÔÓ CÓ AË 7Ï ¾x¯hSʶÈh@9uÈrÐ ÈÏ # § "Ï YA ( Ò % # 8qPqWP G Y(d`7WquGUPs í b67 I qdIa í ©ªYuÀwW4¡ vó ò Í#Þ ÓÐÇ 2 h dìUYÁ ì lY ã R )F ã PUWrtYHF fUdvuhfuquHT ã g Ò % 1zÎ 0rthÓ Ò ¦ÇuÈC Î îì 22 é S csR c TRG R T aGR TsIG á ()§'Ê%&wÛÔ¦qÈCyÓ Î¨Í yr¶Ð&¦ËÈ $Î @8" ¦ÇÈ Y&Î uÜ Î ¦Ì©hÓ Ï SÑ9 YutË Î ¨h¨U v WWYuUdvutuvT ã ó ò CÓ Ô # 9 7 ! ÏÏ ÑÊË Ó È § Ç È ÜÓË Ô Ð Ü ÌÊ î ¼ v T XVIG T aGR `s Q PX q w trrWu5dTWUhG w WYPh5vPh7fqhG"rT ¨7y hhiR PxHWî ¨¨ qt4WdT a v `G  aR T y ` XGR a ` c RR v v XVwR T aGRV cIRGI  I  ŠŠÅR î pGG X × Ö îGR I T

ì v v XV F y P G T v é sI ` v ¼G T Ï Ó Ì ÈÓ ÇA Ì Ð 9 7 ȧ Ç Ó § Ç Æ g T vG ¼ ass ô  irg WY£dV a W$HWuqbUUPHUv I g &Î &DCh¨"B@8¦Çh©t¢Ô Ï Ë Î ¨¥ªUuUWdTuPç ½ × "ìò ó
¡ 6 ¡ © ¡ ¡ h¨U#¦¤

ÂwsIw vG cI a vs p I a sIw I XG c T R `IGw w I XG IV T R X TI vG I aG T vV I Å gGR XG wI aw 7Y7urbuzqWdchPW "ÀVHP7u4WPBrU÷7Pu4Wu 7rtfW7buWdTuHU7WhrPlqÀcuqI ¡ Âq w tfWWPBBUhPWb`rUzqG a us rPxdszxrC7¾WP¥Uh w b2vPhPHqxuWqus 7r2frë aR T y ` XG y cI vs p a c T R RI R G a T v cIw R y yI ½ I XG Q v I c v ` T aGRG TIwIs pI ÅI T c T vG Gs v ¤ I Gw I y I Ù R ` v R I ½  a R T y ` XG Gw IG I XG s vQ aw T v pw Is I aw y I ½ X V R I T v I a s I a R uuU¨¥fUUzu w b¾q w UrWrHP uh R Wu4 I yurfuqPbuGxâ7¾Yq7dVP7uw UrT ÁW¨ I tÀR a u r4udwa W£"U7dVP7uw trWW¨WP7d»PUWrUPxuhÙ a c UllUqqWHÀ¿WT y ` X à y Is R I R X vG R v ¼ s S  I a sI aR T y ` X à I XG I a cs R c T RGw vG I v Å I ÅgwI a Á XVIG T aGR R a yI ÅI T yR TI c TR T aGRG TIwIs pIs yI ½ I vs p a aR T y ` XG GR XG ¼ a YuâUdvutqd» a rudwú7¾½ 7rB I trqârtâUdvutPH7uqPW7PæqÄhuWbd`4 w UrWWutrurT7dI a I ¡

¥© ¦! A ¤ © ¡ ' ©

£

 T a XwR I v T R a yI ½ I XG IV T asI p å UdvWuUSQ hWCT7¾WP£7r7dIP77I vG a T Gs v p p v I XG w I a vs p I V RQs IG a s Iw y I ½ c Iw R y × I Ö s a a R T y ` XG Q v T aG R p p uæqGWruuUWUWPÀcHhPW"SxquHdT7ur 7¾xr¶Á º rUv Tb w trWWut¯UdvuhqdV a WUR I X à  yI ½ I XG Qv w T aGRG TIwIs pIs ÅI T y R TI g ¡ I XG T v cI a vs p c T R cIGRsI TI ¼ g a R T y ` X Wª7¾zWPhtrvPhYqxur7PøqWz I Ur7(W0 r¢Wu¾x( qWdchPWúrU¾utPqW7q w UrWrHPG g wIs R w ô ÂwG TI ` T v a TI a `R T c a TI I a R T y ` XG Qv Iw I XG w Å R g I a sIw GI TsIG ÅI T G uqP¨¨qPHqrUPs7dVbtfHWTCqUq¨ w UrWWutxfWPhv d ¨U7dVP7u7WuquHT ã 7rR w R g s I s I a R T y ` X à I X à  w I aw y I ½ w I vs p a T aw I c y I ½ a a R T y ` XG ¼ a p ` I g Is vQ Is I X U7uqF trWWWqqPqGuú7¾¨UhPWb`¾Ud¼xâ7¾¾dT w tfWWPzWdTh v q©UPU7uqWà I V RQs IG s I × I Ö Å v v é Is "SxquHT ã 7uw ú£º hPs ¡ î PWUd¼a í





Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 5 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 6 of 108

EXHIBIT C

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 7 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 8 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 9 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 10 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 11 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 12 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 13 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 14 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 15 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 16 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 17 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 18 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 19 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 20 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 21 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 22 of 108

EXHIBIT D

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 23 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 24 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 25 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 26 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 27 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 28 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 29 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 30 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 31 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 32 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 33 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 34 of 108

EXHIBIT E

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 35 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 36 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 37 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 38 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 39 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 40 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 41 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 42 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 43 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 44 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 45 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 46 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 47 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 48 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 49 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 50 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 51 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 52 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 53 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 54 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 55 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 56 of 108

EXHIBIT F

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 57 of 108

Computer Networks 31 (1999) 1525­1532

Visual preview for link traversal on the World Wide Web
Theodorich Kopetzky L,1 , Max Muhlhauser 1 ¨ ¨
Telecooperation Department, Johannes Kepler University Linz, Altenbergerstrasse 69, 4040 Linz, Austria

Abstract This paper demonstrates a technique for augmenting current World Wide Web browser implementations with features found in classical hypertext applications but unknown to the World Wide Web community until now. An example implementation is shown using Netscape Navigator 4.x using JavaScript, dynamic HTML and Java. The implementation follows an architecture based on a proxy server which acts as a gateway between the Internet and the browsing client. Based on the detailed example, support for further features is discussed. © 1999 Published by Elsevier Science B.V. All rights reserved. Keywords: Hypertext navigation; User interface; Link preview; World Wide Web

1. Introduction A novice user of the World Wide Web is usually impressed about the vastness of information available. At a second glance the impression gradually turns into desperation when the user tries to actually find valuable information. The usual solution is to contact a search engine like Altavista [1] or a Web portal like Yahoo [25] which usually work as a starting point for global navigation. But even when navigating through small Webs (or hyper-documents), users tend to have navigation problems; in essence, these problems boil down to the decision about which links to follow and which to ignore. Considering a state of the art of about 12 years, little improvement was made. It was as early as 1987 that Conklin [9] mentioned the phenomenon in his late introductory article. Zellweger et al. [26] note that it is especially burdensome to follow a link
L Corresponding 1

author. E-mail: {theo,max}@tk.uni-linz.ac.at

just to find out that it is not relevant for the reader. They state that the reader leaves the source context just to return to the previous reading position after determining the uselessness of the chosen link. We will briefly review what we consider three levels of support for link navigation. (1) Textual hints. Landow [15] appealed to authors to enrich the context of link anchors in order to help users to decide if a link is worthwhile to follow. Furnas [11] discussed the advantages of links having a scent or residue of contents to come (this may be compared to "highway signage" where the sign shows, e.g., what is next and what is farther away). Zellweger et al. [26] introduce the notion of a gloss, which they define as a "brief explanation positioned in the margin or between the lines of a text". A gloss may contain a description of the target of the link, meta-information and more. Some early hypertext systems like HyperTies [16] or the Guide system [5] already address some issues related to glosses. As to the World Wide Web, the Internet Explorer [17] supports a very basic kind of gloss by optionally

1389-1286/99/$ ­ see front matter © 1999 Published by Elsevier Science B.V. All rights reserved. PII: S 1 3 8 9 - 1 2 8 6 ( 9 9 ) 0 0 0 5 0 - X

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 58 of 108

1526

T. Kopetzky, M. Muhlhauser / Computer Networks 31 (1999) 1525­1532 ¨ ¨

displaying a small pop-up window with a textual description of the link to be followed. (2) Typed links. This concise and well-defined remedy to the link navigation problem described has been proposed early on, too. Halasz [13] required typed links, even composite links, in his late "seven issues" article, back in 1988. Manfred Thuring et al. ¨ [20] put up eight design principles and ten cognitive design issues to increase global and local coherence of hyperdocuments, one of them being "use typed link labels". However, typed links are (i) not yet well supported, and (ii) not sufficient. Not well supported refers to the fact that HTML 4.0 offers support for link types like "contents", "chapter", "next", etc. [23], but the standard browsers -- like Internet Explorer [17] and Netscape Communicator [18] -- currently do not support this feature yet. In the context of XML, a special-purpose XML linking language called Xlink [24] is emerging, but its widespread use is still far out. As to the attribute "insufficient", the limits of typed links are obvious. (i) Unless a commonly accepted ontology is given for a field, the semantics of a given link type are known to the user but not to the reader. The latter must infer these semantics either from the type mnemonics (what might a link of type "in-depth" lead to?) from formal or informal descriptions (which distract the reader even more). (ii) Even if both author and reader have a common understanding of link types, the type information is just one kind of abstraction of the target contents. (iii) Additional authoring effort is required, so that typed links are neither a remedy for the bulk of existing World Wide Web documents nor can they be expected to be soon applied by the myriad of Web designers active in the Internet. (3) Further advancements. Bieber et al. [4] categorize hypermedia environments in four generations in analogy to programming languages (machine languages, assembler languages, high-level programming languages, and finally packages like word processors which let users concentrate on what they want to do). They believe that current authors and readers of the World Wide Web are working in a second-generation hypermedia environment. Further, they discuss a set of hypermedia functionalities which they believe to improve the usability of the Web. One of these functionalities is "global and local

overviews", to be achieved by overview diagrams and link previews. Obviously, textual hints and typed links as described above are just two facets of link navigation support. Among the more advanced concepts, work on information shape [10] is cited here just as a sample reference. This example illustrates a common problem with hypertext: many concepts have been studied in the past, but they have a long way to go until they are widely available for the World Wide Web community. In this paper, we describe a technique to implement local overview for Web browsing, called "visual link preview". The approach falls within category 3 described above (further advancements) and at the same time works with standard browsers without authoring effort; in other words, this approach can be made available to the World Wide Web community immediately.

2. Visual link preview An author of Web documents has the following options to provide link information to the readers: z He can describe in the context of the link by text or by image where the link will take the reader. This has been done for example in the image map in Fig. 1.

Fig. 1. The homepage of the Telecooperation Department.

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 59 of 108

T. Kopetzky, M. Muhlhauser / Computer Networks 31 (1999) 1525­1532 ¨ ¨

1527

z He can use the weak support provided by existing browsers. This support is limited to displaying a small text window. z He can use dynamic HTML to enrich each link specification and may provide link information in another window or another frame. All three possibilities demand work to be done by the author. But in the Web environment there is another source of information about the link: the target of the link itself. Usually the reader does not get to see the link target until he has activated the link, leading to the problems stated in the introduction. If the reader has already visited a region of the Web, he has built a mental map. Depending on the time passed the reader may need information in addition to the URL to remember that he has already visited this region. This is were the view of the page at the end of the link, provided as thumbnail preview, may help the reader's memory and will aid him in the decision of following the link. Generating this thumbnail preview by hand can be done for small, static Web sites, but is unfeasible regarding large and fast changing sites on the Web. Thus automatic generation is necessary. In addition to automatic generation these thumbnails have to meet the following requirements: (1) the image should be small to save bandwidth and server space; (2) the image should be in color; and (3) the quality of the image should be good enough to allow the reader to recall the accompanying image of the target of the link from memory; this is also the reason for point 2. For the 1st and the 2nd requirement JPEG [14] was chosen as format for the thumbnail images because it provides small image files with a 24 bits color representation. As for point 3, the quality of the preview images largely depends on the scaling algorithm used. Given the image in Fig. 1, two scaling algorithms are compared. Below the difference between simple pixel resizing (faster) and bilinear resizing (slower, better quality) can be seen. To improve recognition the slower method with better results was chosen. In addition, the second

Fig. 2. (a) pixel resizing, 3628 bytes JPEG file. (b) bilinear resampling, 2884 bytes JPEG file.

Fig. 3. (a) Possible preview for a link to an anchor in a document. (b) Preview of a link to an E-mail address.

method usually yields smaller image files. To see the original image, take a look at Fig. 1. 2.1. Link types Although explicit link types are part of HTML 4.0, no standard browser currently supports those. But links also have implicit types, which can be used for preview purposes. The following list shows which link types are recognized by our system and how they are visualized. As the linking mechanism works with URLs we are using properties of the URLs to categorize a link. z The URL points to the beginning of a Web page, as in http://www.tk.uni-linz.ac.at/. Links of this type are visualized using a thumbnail picture as in Fig. 2b. z The URL points to an anchor, as in http://www .encyclopedia.com/h.html#hypertext 2 . Links of this type may be visualized using a thumbnail picture or, if there is text after the anchor, the text referenced by the link itself may be displayed (see Fig. 3a). z The URL starts with a protocol different from HTTP, like FTP, TELNET, MAILTO, etc. Al2

This is a hypothetical link.

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 60 of 108

1528

T. Kopetzky, M. Muhlhauser / Computer Networks 31 (1999) 1525­1532 ¨ ¨

2.3. The presentation of the link preview A document delivered by the proxy server does not look different to the reader than the original document. The link preview is simply activated by moving the mouse over a link. The presentation of the link preview is animated. This means that the reader has time to accommodate to the new situation. The preview opens below the link and will remain open for seven seconds. The preview can be closed by moving the mouse over the preview and than out of it. The preview will close also when the reader moves the mouse over another link and thus activating a new preview image. To follow the previewed link, the user has the possibility to activate the link itself as usual or to click on the preview image.

Fig. 4. Symbol for a dead link.

though these link types are rather self-explaining a symbol is used to represent the protocol used (see Fig. 3b for an example). In addition to these properties links can have meta-properties, like dead or forbidden. If the reader knows in advance that a link is dead, he can safely ignore it. The symbol chosen for a dead link is presented in Fig. 4. These meta-properties are currently derived from the answer of the Web server where the link leads to, and so for example a 404-error is mapped to the dead end symbol. 2.2. Link preview Fig. 5 shows how the preview looks like using the Netscape Communicator 4.5. In case the reader requests a preview which is not available yet the reader is informed about that fact at the same location, as seen in Fig. 6.

3. Architecture Our aim was to implement link preview without requiring support from the Web author. This approach has the advantage that all existing pages on the Web can be browsed without requiring any change to be made by hand. On the other hand the material has to be changed for the preview to work. To solve this problem an approach using a proxy server was chosen. An overview of the main components of the proxy server, which has been implemented in Java, can be seen in Fig. 7. The proxy server has the following tasks: z analyze the links in a requested HTML document and generate the preview images for all links in the document;

Fig. 5. The mouse pointer (not shown) moved over the Blackboard symbol and the preview opened.

Fig. 6. No preview available information.

Fig. 7. Basic architecture of the proxy server.

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 61 of 108

T. Kopetzky, M. Muhlhauser / Computer Networks 31 (1999) 1525­1532 ¨ ¨

1529

z cache the requested HTML documents and the computed link preview images for future access; z modify the HTML documents in a way that the requesting browser is able to show the link preview images. This approach has the following advantages: z the proxy server has to generate the preview information only once (depending on server space); z many readers can share one proxy server and thus benefit from already generated preview information; z readers only have to make one change in their browsing environment: they have to configure the Web client to use a proxy server -- everything else is done automatically; z the proxy server can use other proxies servers and thus benefit from information already fetched from the Web. 3.1. Flow of events A typical flow of events is described in the following steps (this assumes that in the beginning the required page is cached nowhere). (1) The reader enters an URL. (2) The browser asks the proxy server for the requested document. (3) The proxy server fetches the document from another proxy server or directly from the Web. After the document is fetched completely it is passed to the parser. (4) The parser analyses the document regarding its structure and searches for link information. If link information is found, for each link an internal Web browser will be started. These browsers will be used to generate the preview images. The document is modified to enable link preview by inserting the JavaScript code. After parsing is finished the modified document will be cached and passed to the requesting browser. (5) The requesting browser displays the document. Link preview images may or may not be ready yet. (6) If the reader moves the mouse over a link, the code inserted by the proxy server tries to load the preview image. If it is available at the proxy server, it will be transmitted and displayed, otherwise a notification regarding the missing image will be displayed (see Fig. 6).

Part of these activities happen in parallel to speed up processing.

4. Client-side implementation To enable link preview at the client side, we had to utilize dynamic HTML. Unfortunately Internet Explorer and Netscape Communicator implement dynamic HTML each in their own way. The Internet Explorer uses cascading style sheets [22], which are not fully supported by Netscape's Communicator and the Communicator uses a technique called layers which is not supported by the Internet Explorer. We decided to implement the first version for the leading browser at that time (which was Netscape). 4.1. Layering To display the preview information so-called layers are used. Layers can be viewed as small HTML documents which are displayed in the same browser window. Layers are displayed over the base window thus hiding part of it. In addition, layers may overlap other layers. To enable the browser to show the link preview, the proxy server inserts a layer definition for invisible layers and a short JavaScript program at the beginning of each downloaded HTML-page. An example for a layer definition can be seen in Fig. 8. The position where the insertion actually takes place depends on the structure of the document (if it contains a head tag or a frame set, for example). Additionally each tag is modified to react to events when the mouse pointer moves over the link. A mouseover event-handler is inserted into each link description. This handler will activate a procedure in the inserted JavaScript program if the reader moves his mouse over the link. The handler passes as a parameter the name of the preview image to the procedure. This name was inserted into the link definition just as the event-handler. The procedure will make the invisible layer visible and set some parameter of the layer, e.g. the information which preview image is to be shown. Fig. 9 shows how a document looks like after modification by the proxy server. First there is the inserted layer and JavaScript code. Then follows the

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 62 of 108

1530

T. Kopetzky, M. Muhlhauser / Computer Networks 31 (1999) 1525­1532 ¨ ¨


Fig. 8. A simple layer definition.

browser is started. Imagine a reader following a link to a Web page containing a link index with hundreds of links. The proxy server will need some time to build all the preview images. z The size of each HTML document transferred from the proxy server to the client increases approximately by 2 kb. z It may interfere with already existing JavaScript and layer code in viewed documents. This can be averted by parsing the document for names used by our system and adapting naming conventions on the fly.

6. Related work 6.1. Classical hypertext
Fig. 9. Client side architecture.

modified HTML code which still may contain links without preview code (e.g. if the parser was not able to parse link information correctly). Preview images are fetched on demand from the proxy server.

Different types of link preview or displaying the link type exists in several classical hypertext systems, like for example in Sepia [19] which displays the link label next to the link arrow in its link overview diagrams or in HyperTies [16], where a brief description is displayed at the bottom of the screen. 6.2. The Web There exists an interesting concept which is called displets [21]. Displets provide a principled way to extend HTML. In their proof of concept implementation the authors implemented among others a displet for anchor groups (a way to implement multi-endpoint links (see also [4]) and anchor labels. Because displets are implemented as Java classes, they may show any image as well but they lack the server-side component which generates the preview images.

5. Limitations Unfortunately the current implementation has some limitations: z It only works with the Netscape Communicator. If an Internet Explorer is configured to work with the preview proxy, no preview is available. However, normal usage is not restricted. z The proxy server needs a lot of bandwidth to build the preview images because for each link encountered and not found in the cache a Web

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 63 of 108

T. Kopetzky, M. Muhlhauser / Computer Networks 31 (1999) 1525­1532 ¨ ¨

1531

6.3. Other user interfaces A lot of different approaches exist to display an overview of large information spaces, like PadCC [3], which uses an interactive panning and zooming navigation metaphor, or distortion-oriented viewing techniques like the generalized fisheye views [12], which employs a distorted representation of out-offocus material. Zooming has as disadvantage that the material in focus is moved out of focus if the reader zooms in on a detail. Another disadvantage is that zooming is difficult to integrate in standard Web browsers unless one is willing to implement a plug-in for a browser. Our approach integrates well and requires minimal user intervention to be set up. Distorting techniques have the same limitations as mentioned with zooming when trying them to integrate in a browser and usually need their own window to work effectively. Our approach reuses the available screen space. 6.4. Link services An interesting approach to enhance usability of the World Wide Web is the use of a link service [7]. Via link services readers can gain a surplus of information by applying different sets of links to one and the same Web document. Link services store link information external to the documents linked. Current implementations (as shown in [8]) do not store thumbnail information along with the link information. We think that by storing the preview image link services could gain attractiveness. z

Fig. 10. Excerpt from "As We May think".

z

z

z

from "As We May Think" by Vannevar Bush [6]. A preview window opened below the link "wholly new forms of encyclopedias" revealing two links to choose from. This technique can be easily adapted to display more links. Displaying more information about a link. This could be, for example, the ping time to the server where the link is pointing to. Other interesting information could be keywords associated with a link (as long as provided in a format understood by our system). More control over the preview. Currently, control is limited to the states "preview on" and "preview off". Users could, for example, define which link to preview in which manner. There are some interesting "fluid link" [26] techniques that we are interested in to mimic on the Web. As the proxy server approach is basically an intermediary approach as introduced in [2] we are looking into utilizing the power of the Web Browser Intelligence (WBI) architecture.

8. Summary 7. Future work As already stated the current implementation only works for Netscape 4.x browsers. We are currently working on a version which will include full support for the Microsoft Internet Explorer as well. In addition we are considering to implement the following features. z Support for visualizing 1 to n links and selecting them in a screen estate saving way. An example can be seen in Fig. 10 which shows an excerpt Visual preview of the target of a link can provide valuable clues for the reader when making the decision if to follow the link or not. We have shown that a simple preview service can be implemented using standard Web browsing software and described an implementation which requires minimal user activities to be set up and does not need additional client software. We are continuing to develop our approach adopting to new technologies as they become available and integrating novel navigating concepts.

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 64 of 108

1532

T. Kopetzky, M. Muhlhauser / Computer Networks 31 (1999) 1525­1532 ¨ ¨ ing knowledge in hypertext systems, IEEE Computer (January 1988) 70­80. Microsoft, Internet Explorer 4.01, http://www.microsoft.co m/windows/ie/ie40/ Netscape, Netscape Communicator 4.x, http://developer.net scape.com/ N. Streitz, J. Haake, J. Hannemann, A. Lemke, W. Schuler, H. Schutt, M. Thuring, SEPIA: a cooperative hyperme¨ ¨ dia authoring environment, in: Proc. 4th ACM Conf. on Hypertext, Systems I, 1992, pp. 11­22. M. Thuring, J.M. Haake, J. Hannemann, Hypermedia and ¨ cognition: designing for comprehension, Communications of the ACM 38(8) (1995). F. Vitali, C.-M. Chiu, M. Bieber, Extending HTML in a principled way with displets, in: Proc. 6th WWW Int. Conference, Computer Networks and ISDN Systems 29(8­ 13) (1997) 1115­1128. World Wide Web Consortium, Cascading style sheets, http://www.w3.org/Style/ World Wide Web Consortium, HTML 4.0 Links: document relationships: the LINK element, http://www.w3.org/TR/R EC-html40/struct/links.html#h-12.3 World Wide Web Consortium, XML XLink Requirements 1.0, http://www.w3.org/TR/NOTE-xlink-req/, February 1999. Yahoo, http://www.yahoo.com/ P.T. Zellweger, B.-W. Chang and J.D. Mackinlay, Fluid links for informed and incremental link transitions, in: Proc. ACM Hypertext '98, 1998, pp. 50­57. Theodorich Kopetzky is a Ph.D. candidate at the Telecooperation department at the Johannes Kepler University of Linz. He received his master of Computer Sciences in 1993 and worked afterwards in the field of embedded systems. He began to work as a researcher at Telecooperation department in 1996. His research interests are hypermedia authoring, navigation, and webbased training. Max Muhlhauser is a full profes¨ ¨ sor of computer science and head of the Telecooperation Research Group at Linz University, Austria. His research domain is software engineering for distributed multimedia systems, mobile and ubiquitous computing, and human­human and human­computer cooperation. He received his diploma and PhD. in computer science from Karlsruhe University, Germany, in 1981 and 1986, respectively. He is a member of ACM, the German Computer Society, and IEEE.

Acknowledgements I would like to thank Shai Kariv, Noam Ambar, and Amir Gur for letting me use the source code of their basic proxy server, and Ronald Angerer and Andreas Schwediauer for implementing parts of the system.
[17] [18] [19]

References
[1] AltaVista, http://www.altavista.com/ [2] R. Barrett and P.P. Maglio, Intermediaries: new places for producing and manipulation Web content, in: Proc. 7th Int. World Wide Web Conference, Comput. Networks and ISDN Systems 30 (1998) 509­518. [3] B.D. Bederson and J.D. Hollan, PadCC: a zooming graphical interface for exploring alternate interface physics, in: Proc. ACM UIST '94, 1994. [4] M. Bieber, F. Vitali, H. Ashman, V. Balasubramanian and H. Oinas-Kukkonen, Fourth generation hypermedia: some missing links for the World Wide Web, International Journal of Human­Computer Studies 47 (1997) 31­65. [5] P.J. Brown, Turning ideas into products: the Guide system, in: Proc. ACM Hypertext '87, 1987, pp. 33­40. [6] V. Bush, As we may think, Atlantic Monthly 176 (1945) 101­108, http://www.theatlantic.com/unbound/flashbks/co mputer/bushf.htm or http://www.ps.uni-sb.de/¾ duchier/pub/ vbush/ [7] L.A. Carr, D. De Roure, W. Hall and G. Hill, The distributed link service: a tool for publishers, authors and readers, in: Proc. 4th Int. World Wide Web Conference, Boston, MA, USA, O'Reilly and Associates, December 1995. [8] L.A. Carr, D. De Roure, W. Hall, G. Hill, Implementing an open link service for the World Wide Web, World Wide Web Journal 1 (1998) 2. [9] J. Conklin, Hypertext: an introduction and survey, IEEE Computer (September 1987) 17­41. [10] A. Dillon, M. Vaughan, It's the journey and the destination -- shape and the emergent property of genre in evaluating digital documents, New Review of Hypermedia Multimedia 3 (1997) 91­106. [11] G.W. Furnas, Effective view navigation, in: Proc. ACM CHI '97, Human Factors in Computing Systems, pp. 367­374. [12] G.W. Furnas, Generalized fisheye views, in: Proc. ACM CHI '86, 1986, pp. 367­374. [13] F.G. Halasz, Reflections on notecards: seven issues for the next generation of hypermedia systems, Commun. ACM 31(7) (1988) 836­852. [14] JPEG, Joint Photographic Experts Group, http://www.jpe g.org [15] G.P. Landow, Relationally encoded links and the rhetoric of hypertext, in: Proc. ACM Hypertext '87, 1987. [16] G. Marchionini, B. Shneiderman, Finding facts vs. brows-

[20]

[21]

[22] [23]

[24]

[25] [26]

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 65 of 108

EXHIBIT G

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 66 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 67 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 68 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 69 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 70 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 71 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 72 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 73 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 74 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 75 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 76 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 77 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 78 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 79 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 80 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 81 of 108

EXHIBIT H

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 82 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 83 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 84 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 85 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 86 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 87 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 88 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 89 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 90 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 91 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 92 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 93 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 94 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 95 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 96 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 97 of 108

EXHIBIT I

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 98 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 99 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 100 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 101 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 102 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 103 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 104 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 105 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 106 of 108

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 107 of 108

EXHIBIT J

Case 1:07-cv-00787-SLR

Document 77-2

Filed 05/16/2008

Page 108 of 108

CONFIDENTIAL EXHIBIT
FILED UNDER SEAL