Name Abbreviations PD Paul Debevec JD Jeff Davis PB Peter Bosselman GB George Borshukov JL Jason Luros MN Michael Naimark YY Yizhou Yu CW Chris Wright AV Al Vera CB Cris Benton SM Susan Marquez AG Al Gunston EP Eric Paulos PP Peter Pletcher VJ Vivian Jiang SK Sami Khoury TH Tim Hawkins DP Dorrice Pyle LK Lindsay Krisel JM Jitendra Malik CY Charles Ying OC Oliver Crow LB Linda Branagan When Who What ---- --- ---- 2/13 CB/PD/EP CB lab visit 2/17 CB/PD Test kite flight over PSR Quad 2/24 PD/CB/JD Campanile Walk-up, took some test photos in trinocular configuration 2/27 PD Project announced to CS184 class 2/28 PD/JL/VJ VJ and JL join project to help create models PD PD visit to Interval Research Corporation for production advice 3/02 PD/EP Tested Range on MicroVideo Transmitter - worked at 525 feet PD/CW CW joins project for video editing, possible animation PD Production homepage created 3/04 PD PD visits ILM, gets advice on interlacing 3/05 GB/YY Texture mapping demos, RE2 upgrade to 16MB texture cache 3/06 PD Campanile shot planning w/ laser range finder PD/GB VDTM extrapolation method discussed PD Contacted SM at DOFM for Campanile plans 3/07 PD Contacted Microvideo and Falcon re: equipment 3/08 PD First campus aerial photo provided by Al Vera of DOFM 3/11 PD/JL Tried creating user accounts for 184 folks, problems PD Met with SK 3/12 PD/JL Create user accounts for JL, bypassing mount difficulties CB Drops off KAP negatives to PD PD/CB/PB Demo for Peter Bosselman, with assistance from GB and YY PD Followed up with SM re: Campanile plans PD Scans selected CB KAP images 3/13 PD/SK Met with SK to set up accounts, discuss camera moves PD/PB PD drops by Wurster to PB's lab for temp. Campanile model PD/PB PB announces he could lend a 16mm arriflex camera to project 3/14 PD Demo for SF Examiner science writer Keay Davidson PD First screen tests with model taken on Hi8 near Esplanade PD Mounting problem resolved; project accounts now working PD/MN PD gets info from Michael Naimark re: standard cinematic focal lengths, 16mm film transfer PD/SM SM drops off complete Campanile plans and campus map to PD, receives demo PD/AV Complete aerial photograph set FTP'ed from DOFM 3/15 PD/CH Discussed video deinterlacing algorithms PD Began geometric calibration of film scanner PD/EP Tested video digitizer in Authoring room PD/GB Disscussion of 3rd generation VDTM algorithm 3/16 PD/SK Meeting to discuss camera match move and keyframing method PD Rescanned calibration shots with Nikon scanner 3/17 PD/TH/JD Model test shoot at Campanile PD Ascertained Campanile location to be N 37.52.172', W122.15.545' using Garmin GPS unit (like that helps anything) PD/GB/YY Mental Storyboard planned with 6 fades, no knockover PD Environment modeling begun from aerial photographs, six buildings completed GB/YY New coordinate system for VDTM algorithm 3/18 PD/CW Flesh out video requirements for project PD Obtained quote on VX1000 camcorder from B&H PD/AV PD visit to DOFM, original photos may be available PD/SM Discuss plot and story 3/19 PD/SK Meeting to determine match-move milestones PD Placed order for MicroVideo equipment GB Demonstrates multisample buffering following SGI suggestion PD/VJ/JL Meeting to discuss computer Campanile model PD/CB Discussion re: kite scheduling PD Mailed LB for advice on ET submission PD/CW Tested digitizing, fades, titles in Premier PD/AG Placed order for network services for camaro.cs 3/20 PD/JL More Campanile modeling discussion PD Placed order for Microvideo devices PD/CB Neg pickup and kite shot planning PD Radial distortion calibration for 24mm lens 3/21 PD/JD Got information on extended Campanile hours PD Bought supplies at Fry's electronics 3/23 PD/CW O2 hauled into graphics lab, began set up PD/CW Outdoor shot planning, video compression tests 3/24 PD Ordered Steadycam Jr. &c from Adorama PD Spoke with LB for submission advice PD Began setting up camaro.cs on network, requested network PD Checked on Microvideo Equip. 3/25 PD Picked up HJW photos from John Hickey PD/VJ Planned improvement to Campanile upper deck, chose units for computer model ( 1 inch = 0.001 ) VJ Roughed out new Campanile upper deck PD Finished networking O2, still waiting on network PD Rescanned four HJW aerial photos w/ fiducials PD lux set up, masquerading as indian 3/26 VX1000, Microvideo equipment arrives PD Figures out how to work VX1000 PD/CB Play around with Microvideo equipment, transmitter problems PD/CB Calibrate Microvideo camera field of view (70x50deg) PD/CB Attempted ground kite run SK Spatial spline code nearly working PD some test footage taken ground level at Campanile CB Designs kite mount for Microvideo transmitter/camera PD/CB Discuss ground shots and relevance to story 3/27 PD Supplier for wide-angle attachment for VX1000 located PD Rectification of HJW aerial shots PD Calibration shots taken for 15mm lens PD Ground-level 200mm shots taken all around Campanile ~12:30pm CB Calculates sun position change for 12:23-12:48pm PD Ledge stills taken on upper deck of Campanile CB Successful kite launch and flight from upper deck of Campanile wind too weak for camera rig PD Rehearsal of upper deck scene w/ model on VX1000 3/28 PD Supply acquisition: film & batteries at Costco Wide angle attachments at Gasser's in SF Got info on DPS Spark Digital Video Card PD Dropped off film at Sarber's PD Picked up film from Sarber's 3/29 SK/PD Continued discussions on flight path; position working PD Conversion of intrinsic data for HJW shots 3/30 PD/CB Kite flight over Campanile, windy + Cloudy PD Environment map built up to 16 buildings PD Calibration shots taken for VX1000 with Sony and Kenko converters PD Demo of environment model JL Worked on lower Campanile model 3/31 PD Dropped off film at Sarber's PD Environment up to 21 buildings, five photos CW/PD Digitized camcorder calibration shots, 3/27 ledge test movie JL Continued work on Campanile model PD/YY Attempted Terrain modeling, Facade problem encountered YY Runs visibility algorithm on aerial environment - works! GB Runs VDTM algorithm on aerial environment - works! GB Gets texture mapping working with 1K x 1K textures PD/GB/YY Discuss method of rendering Campanile and Environment 4/01 PD Picks up film from Sarber's GB/PD Selection of shots for Campanile texture model YY/PD Selection of kite shots for environment model PD Scans selected 24mm images from Kite run - scanner anomaly noticed, experimented with scanning settings JL/PD Planned photogrammetric extraction method for bottom deck of Campanile PD Created frustum-with-hole block CB Locates model builder candidate Dorrice Jane Pyle 4/02 CB/PD Review of KAP photographs CB/PD/DP Discussion of model building - textures to be delivered on Friday; Model to be done on Wednesday GB Worked on terrain mapping functionality in Facade SK/CW Discussed match-moves and flight path issues CW Set up Steadycam Jr. VJ/JL/PD Continued work on modeling Campanile, now with frustumhole block allowing (hopefully) for fully photogrammetric model PD Continued work on calibrating kite pictures from Nikon scanner YY Created 1st terrain from Triangulation of building bottoms GB Created 1st terrain / environment / Campanile renderings 4/03 PD Picked up missing HJW photo 3-6 from John Dickey PD Wrote rectified undistortion code CW Practiced shooting Campanile twirls with Steadycam JL Continues work on lower level CB/EP Try to find problem with transmitter - discover it's has some sort of problems GB Wrote point location code, wrote first version of UI 4/04 DP Picks up additional plans and photos Model work begun 4/05 DP/PD Discuss possibility of painted model rather than photo model SK Position splining done; rotation splining begins JL/PD Photogrammetric bottom level begun PD Refinements to Environment model CW/PD Discuss filming possibilities and technique CW/PD Discuss possibilities for introductory documentary PD Calibrates 24mm lens intrinsics > with Facade < 4/06 CB Cloudy: Attempts taking Kite shots of the environment wind too weak PD Takes environment shots from upper deck of tower, not enough time to visit the lantern PD Measures bricks at base of Campanile PD Drops off additional photos, plans, and measurements to DP; discusses model issues CB Authors first version of Sather Tower project page 4/07 PD Drops film off at Sarber's; picks up negatives PD Undistorts remaining scanned 24mm photos PD Begins and finishes 200mm calibration PD Develops method of merging two facade projects, crucial for bringing together VJ and JL's models GB Works on incorporating camera paths into renderer SK/PD Continued discussions on rotation splining PD Finds formula for quaternion <=> angle/axis PD/GB Discuss which environment shots to use, color correction, tree modeling, hole filling 4/08 PD Scans in 4 15mm environment shots PD/YY/GB Discuss possibilities for hole filling, tree creation PD Does distortion calibration on VX1000 w/ Sony 0.7 converter PD Begins intrinsic calibration on VX1000 CW/PD Discuss shooting schedules GB Adds in celestial sphere sky model JL Continues work on lower deck SK Begins slerp work PD Scans in 15mm calibration shots PD Discusses 15mm calibration possibilities with Phil DP Model pieces cut, painting beginning, possibly done Thurs pm 4/09 PD Does traditional undistortion on 15mm lens, not quite perfect PD Scans in Cory Courtyard pictures for 15mm calibration based on points seen under pure rotation; recodes distortion solver for sin a/2 projection SK Finishes slerp code, w/PD creates first virtual flightpath through model, to be handed off to GB PD Hands off undistorted photos of Campanile to VJ, explains block creation VJ Continues work on upper deck w/new photos YY Toils on object-space hole-filling algorithm 4/10 PD/GB Discuss far-range environment mapping, hole filling PD/DP Visit to check on physical model, a few horizontal adjustments necessary VJ Continues upper part of Campanile; nearly done JL/PD Bottom section of Campanile model nearly complete, entirely photogrammetric CB/JD Discuss music use for the piece PD Continues undistortion work - unhappy with asin. Considers reshooting calibration grid using Elan II GB Adds interlacing, movie output options to renderer GB First Campanile flight w/ Environment rendered, played back in real time from RAM. Kicks. PD Adds simple camera, project single block, simple deinterlace, next/prev portal commands to Facade 4/11 PD/LK Discuss and develop storyboard, live-action shots PD/SK/GB Review flightpath, identify keyframe rotation anomaly DP/RB Finishes the model, making horizontal width adjustments DP Delivers model to Soda Hall YY/GB Develop new hole-filling algorithm CW/PD Prototype documentary with reasonably random screen recordings PD/GB/YY Transfer first flight to video, in both interlaced and CW/SK non-interlaced formats. Continues to kick. PD/SK/TH Derive Catmull-Rom spline method for rotation group 4/12 PD/CW/TH Shoot all five live action shots under mostly cloudy conditions from 10am to 6pm. PD Shoots environment panorama from Campanile lantern, made possible by TH 4/13 PD Drops off film from 4/12 at Sarber's PD Meeting to update on project, pick up film PD/GB Selection of Environment map shots (24mm shots chosen), development of environment mapping method JL Finishes Campanile lower deck model PD Scans environment shots PD Copies DV tape w/time stamps to SVHS GB Adds TIFF output functionality to renderer GB/PD Line up North environment shots to campus model, reconstructing Haviland Hall - wonderfully consistent alignment achieved 4/14 PD Calls EP, invites to Berkeley for Thursday afternoon PD Calls LB, invites to Berkeley for Thursday evening SK Codes Catmull-Rom orientation splining GB Registers North images with environment GB Improves Evans Hall model PD/CW/ Selection of live-action shots to use in the movie GB/YY/JL CW Digitizes the live action PD/CW Choose match sequences, CW transfers as TIF sequence PD Deinterlaces and undistorts the match sequences PD Adds Copy Correspondences feature for match-move generation PD Reviews and adjusts lower Campanile model CW Begins piecing together first few cuts of live actions PD/JL Go over upper tier Campanile model; discover Facade bug with lines that go behind image plane PD Merges upper and lower Campanile models GB Finishes aligning environment shots to environment model; excellent alignment GB Runs visibility and renders environment model, still lacking trees and infinite terrain. EP Arranges visit by "Wired" writer for Friday 4/15 VJ Makes fixes to Campanile upper deck, adds some new images PD Does Taxes SK/PD Work on debugging rotation splining, math still funny JL Completes gamma shot match-move key frames YY Redoes visibility algorithm for better hole filling YY/GB Work on debugging visibility algorithm PD/GB Add more buildings to campus model, including Tan Hall not yet built when aerials were taken PD/GB/JL Somehow manage not to totally freak out when alberti crashes violently at 1:30am and refuses to boot, seemingly taking the 9gig drive with it. PD manages to boot w/o drive and mount the disk after multiple fsck's. Essential files that were on alberti, such as the Campanile model, are immediately copied to other disks, key non-project material is backed up to tape. 4/16 PD Adds new reconstruction options, resets constants to allow for especially large models JL Completes deltaIn match-move GB Finishes modeling the Campanile environment PD Adds rest of images to Campanile model, adds embellishments PD/GB Devise method of combining Campanile and Environment at correct scale using photogrammetric measurements 4/17 PD/CW Ellen Perry visits to provide advice for film, suggests cut-in on intro shot, emphasizes need for well-done music, Provides suggestions for an interview-style documentary. PD/CW Meet with LB, get many good suggestions for CAF submission GB/YY Render environment model with hills PD Adds various support in Facade for flightpath generation 4/18 PD Interview with reporter David Pescovitz for possible LA Times article JL/PD Format and mount 4gig drive on camaro.cs JL Completes first version of match moves GB/YY Environment model and visibility refinements PD/CW/GB Choreograph the two flight paths using physical model JL Decision: gamma-delta to be pastoral, delta-epsilon to require change of pants 4/19 PD/CW Implement and match-move gamma-delta flight path YY Completely redoes visibility, all in object space, and fills the holes GB Improves renderer GB/PD Add subtle synthetic lighting to Campanile model to match asymmetrical lighting in environment shots. GB Renders first full gamma-delta flight path PD/CW Discuss documentary 4/20 PD/GB/CW Demo for Professor Jitendra Malik. PD no longer worried JL/JM about getting reimbursed for the project. JM: "OK, which of this is real and what is the computer?". GB: "This is all the computer." CB/CW/PD Demo for Professor Chris Benton and son Charlie. "This is cool!" PD asks if CB can get carillon recordings from JD for tomorrow. PD Plans documentary GB Fixes triangulation problem with environment horizon 4/21 PD/SK Final changes to Flightpath code - invent Campanile-centric coordinate mapping, which eliminates wobble from first shot but ruins the final downward-looking flyover in the second shot; hybrid method implemented but fails to be seamless CB Picks up two CDs of bell tower music from music library, delivers to Soda Hall, participates in auditioning tracks PD Adds a couple features to Facade for auto-rotate for producing documentary footage PD 800pm begin scripting documentary PD/CW Record documentary narration GB Rewrites sky rendering method to texture map original sky where available CW Redoes both flight paths PD/GB/CW Record some documentary footage off of artemis GB/PD/CW 500am begin renderings on artemis (video) CW Selects and sequences audio and video clips for documentary, begins to assemble it PD/CW/CY Select music track for jury version and digitize it PD Records match-move and flight path screen shots for documentary PD Creates montages of environment and tower images for documentary CW 9am first sequence finishes rendering, transfers over CY Creates titles and credits in Photoshop, using scan of Campanile arches 10am-5pm Incredible amount of work done, little documented 4/22 PD 505pm - Drops off UPS copy at Mining Circle # 1269777946 GB 600pm - Drives Fedex copy to Emeryville # 0842 7909 073 PD 730pm - At home, discovers bad audio on VHS copy PD 900pm - Leaves for University of Washington 4/23 PD 900am - At UW, checks audio on SHVS copy, which is bad too PD 924am - Mails everyone back at Berkeley about sound AG/CY/CW 200pm - Send repaired video via courier to Jury in Los Angeles PD 300pm - Gives facade talk to UW audience of approx 50 people, premiers the tape at end of talk (using emergency backup off of Hi8 camcorder), to wild applause. 6:27pm PDT repaired video arrives in LA 6:00pm PST (=7:00pm PDT) Computer Animation Festival Deadline ---------------------------------------------------------------------------- Post-Submission Events ---------------------------------------------------------------------------- 4/25 PD Screening at Microsoft Research for Jim Blinn, Jim Kajiya, Rick Szeliski, Hugues Hoppe, Andrew Glassner, Michael Cohen 4/28 PD/GB/YY Screening of jury submission for JM 5/12 Los Angeles Times article runs, "Putting more Reality into Virtual Reality" Screening at Interval Research Corporation 5/20 Interview and Demos for BAY-TV with reporter Mary Duann 5/22 Notification of acceptance to ET and CAF received from Judith Crow of Digital Domain 5/28 BAY-TV segment airs 6/18 Final version of ET and CAF versions completed and sent to the CAF committee. The final version included the following additions and improvements: PD/CY/OC All-digital production using newly available DPS Spark PP card for digital connection to VX1000, connected to BMRC Pentium due to Pentium Pro Compatibility issues CY/GB Color corrections applied to the photographs PD repair of the "Hayward fault" - small gap in panorama running through the football stadium GB faster rendering algorithms PD re-animated flight paths with improved interpolation algorithms PD/TH new timing on flight paths to better match musical cues PD improved match-moves PD some color balance morphing done between video and renderings PD/CY/TH new digital voiceover for the documentary CY digitally remastered and re-edited documentary PD/TH 12 seconds deleted from introductory sequence, with reshot alpha sequence that shows the real Campanile at the beginning PD/TH Spliced audio to sync with 12-second gap PD/TH/CY New prolog for ET version to replace the documentary and thus cut to three minutes. The Campanile bell was recorded digitally, and used to sync with four screens of text to introduce the feature. PD/GB Epilog added - showing the Tower and Environment photographs, then recovered 3D model rotating with a pull-back, and a wipe to the fully rendered model PD/TH Spliced version of second movement of carillon piece to sync with epilog PD New credit sequence 6/23 PD Resubmission of final version with repaired audio track, necessary due to asinine audio resampling algorithm in Adobe Premier 3.0 7/14 PD Extended credits for video version completed 8/01 GB/YY/PD Realtime demo (22fps) completed, presumed to run at 60fps on InfiniteReality 8/02 PD Delivers realtime demo to SGI 8/04 SIGGRAPH'97 Electronic Theatre Premier 8/05 Realtime demo begins showing in SGI booth - 60fps works! PD/GB/YY Attend SIGGRAPH'97 Electronic Theatre JM/CW/JL TH 8/08 JM/PD Documentary shown during image-based rendering panel Live demo shown during InfiniteReality paper
May '97 LA Times article "Putting More Reality into Virtual Reality" 5/12 BAY-TV News segment 5/28 Aug '97 SIGGRAPH'97 Electronic Theatre, Los Angeles Shrine Auditorium Sep '97 Mentioned in Animation World Magazine, "The Films of SIGGRAPH `97: A Coming of Age" by Avi Hoffer http://www.awn.com/mag/issue2.6/2.6pages/2.6hofferfilms.html Excerpt featured on Chine Lanzmann show on Canal + TV, France http://www.cplus.fr/html/cyberflash/97-98/s39/evenement39.html Featured in Disney's "Best of the Electronic Theatre" Compilation Oct '97 Shown at "Digital Images Show", Premio Immagine '97, Milan Shown on NHK HDTV channel, Japan Shown on "Metropolis" show, TVE, Spanish National Television Featured in "Hollywood 2.0" article in Nov. Wired magazine http://www.wired.com/wired/5.11/hollywood.html Nov '97 Wins Industry Award in Multimedia Content Association of Japan's "Multimedia Grand Prix '97" competition http://www.infoweb.or.jp/mma/mmgp/97awards/sakuhin/index.htm Jan '98 Shown at the Sundance Film Festival by filmmaker Robert Miller during the panel "Thinking Differently: The Digital Palette and the Independent Filmmaking Community", Park City, UT Feb '98 Shown in "Le Festival du Dessin Anime", Brussels, Belgium http://www.awn.com/folioscope/pangb98.html Shown on Fuji TV "News 555 The Human", Japanese National Television Mar '98 Shown at Conduit '98 film festival, Austin, Texas http://www.conduit.eden.com/Pages/conduitprogram.html Featured on "Science" TV program, Osaka, Japan Hosted by Dr. Oumura Koichi and Ms. Keiko Kubo Sep '98 Excerpt shown on Canal+ program "Cyberculture" with Chine Lanzman, also featuring clip from "Rendering with Natural Light"