comscore Google built a 'Frankenphone' rig with 5 Pixel 3 smartphones to improve portrait shots
News

Google built a 'Frankenphone' rig with 5 Pixel 3 smartphones to improve portrait shots

Google Pixel 3 and Pixel 3 XL demonstrate what data and computational photography can do a lot with just one camera.

  • Published: November 30, 2018 12:31 PM IST
Google Pixel 3 XL (24)

Google Pixel 3 and Pixel 3 XL, despite all the bugs and issues reported by users, have among the best camera on any smartphones right now. One of the curious elements of the Pixel 3’s camera system is that it achieves most of what competing devices are capable of with a single lens. While competitors like Samsung, Apple and Huawei use a secondary lens for depth effect, Google uses only single lens to achieve the same and in some cases, portrait shots from the Pixel 3 are much superior than those from rival devices. Also Read - Google Pixel 4a sold out in 30 minutes at Flipkart’s Big Billion Days sale

Also Read - Google Meet app for Android gets new interface and features

As was the case last year with the Pixel 2 and Pixel 2 XL, Google uses software and other computational photography to achieve this effect. Now, in a blog post, Google explains how it predicts depth using a single camera system on the Pixel 3 and Pixel 3 XL. Rahul Garg, Research Scientist and Neal Wadhwa, Software Engineer, write that the Pixel 2 used phase-detection autofocus (PDAF) pixels (also known as dual-pixel autofocus) along with a traditional non-learned stereo algorithm to capture portrait mode images with blurred background. Also Read - How to unsend or recall emails on Gmail?

Since the dual-pixel PDAF system is capable of shooting two slightly different views of the same scene, Google exploited the tech to create a parallax effect for portraits. This is further used to create a depth map in order to achieve the bokeh effect. With the Pixel 3, however, Google says it wanted to improve on these fundamentals and produce even better pictures.

In order to achieve better portrait shots on the Pixel 3, Google says it turned to machine learning that allows improved depth estimation and produces even better results. Google says the machine learning algorithm is trained to understand that depth produced from stereo algorithms is only one of the many cues present in images. One such new cue it added this year is the comparison of out-of-focus images in the background with sharply focused images that bring the subject closer and Google calls it defocus depth cue.

It also added other cues including one called semantic cue, which counts the number of pixels in an image of a person’s face to understand how far away that person is from the camera. With the data and cues in place, Google used machine learning to create an algorithm that combines all this data for more accurate measurement of depth.

The most bonkers thing that Google did is build a custom “Frankenphone” rig to train the neural network. The rig consisted of five Pixel 3 phones along with a Wi-Fi based solution allowing it to simultaneously capture pictures from all of the phones. It also says that these pictures were captured within a tolerance of around two milliseconds. The result from the rig was used to compute high-quality depth from photos by using structure from motion and multi-view stereo.

Watch: Google Pixel 3 XL Hands-On

Google says five different viewpoints allowed to create parallax effect in five different directions and achieve more accurate depth information. While industry moved to as many as four cameras, Google is setting a strong example as in how data and computational photography can do all of the same with just one camera.

For the latest tech news across the world, latest PC and Mobile games, tips & tricks, top-notch gadget reviews of most exciting releases follow BGR India’s Facebook, Twitter, subscribe our YouTube Channel.
  • Published Date: November 30, 2018 12:31 PM IST


You Might be Interested

Google Pixel 3 XL

83000

Android Pie
Qualcomm Snapdragon 845 octa-core SoC
12.2MP
Google Pixel 3

71000

Android 9 Pie
Qualcomm Snapdragon 845 octa-core SoC
12.2MP

new arrivals in india

OnePlus 8T
OnePlus 8T

42,999

Samsung Galaxy F41
Samsung Galaxy F41

15,499

Apple iPhone 12 Pro Max
Apple iPhone 12 Pro Max

1,29,900

Apple iPhone 12 Pro
Apple iPhone 12 Pro

1,19,900

Apple iPhone 12 Mini
Apple iPhone 12 Mini

69,900

Apple iPhone 12
Apple iPhone 12

79,900

Poco X3
Poco X3

16,999

Realme Narzo 20A
Realme Narzo 20A

8,499

Realme Narzo 20
Realme Narzo 20

10,499

Realme Narzo 20 Pro
Realme Narzo 20 Pro

14,999

Oppo F17
Oppo F17

17,990

Samsung Galaxy M51
Samsung Galaxy M51

24,999

Poco M2
Poco M2

10,999

Oppo F17 Pro
Oppo F17 Pro

22,990

Realme 7 Pro
Realme 7 Pro

19,999

Realme 7
Realme 7

14,999

Xiaomi Redmi 9A
Xiaomi Redmi 9A

6,799

Vivo Y20
Vivo Y20

12,990

Xiaomi Redmi 9
Xiaomi Redmi 9

8,999

Nokia 5.3
Nokia 5.3

13,999

Motorola Moto G9
Motorola Moto G9

11,499

Realme C15
Realme C15

9,999

Realme C12
Realme C12

8,999

Samsung Galaxy Note 20
Samsung Galaxy Note 20

77,999

Xiaomi Redmi 9 Prime
Xiaomi Redmi 9 Prime

9,999

Oppo Reno4 Pro
Oppo Reno4 Pro

34,990

Samsung Galaxy M01 Core
Samsung Galaxy M01 Core

5,499

Realme 6i
Realme 6i

12,999

Asus Rog Phone 3
Asus Rog Phone 3

49,999

OnePlus Nord
OnePlus Nord

24,999

Infinix Smart 4 Plus
Infinix Smart 4 Plus

7,999

Xiaomi Redmi Note 9
Xiaomi Redmi Note 9

11,999

Samsung Galaxy M01s
Samsung Galaxy M01s

9,999

Vivo X50 Pro 5G
Vivo X50 Pro 5G

49,990

Vivo X50 5G
Vivo X50 5G

34,990

Realme C11
Realme C11

7,499

Poco M2 Pro
Poco M2 Pro

13,999

Realme X3
Realme X3

24,999

Realme X3 SuperZoom
Realme X3 SuperZoom

27,999

Tecno Spark Power 2
Tecno Spark Power 2

9,999

Oppo A12
Oppo A12

9,990

Oppo A52
Oppo A52

16,990

Samsung Galaxy A21s
Samsung Galaxy A21s

15,999

Oppo Find X2
Oppo Find X2

64,990

Motorola One Fusion Plus
Motorola One Fusion Plus

17,499

Samsung Galaxy A31
Samsung Galaxy A31

20,999

Samsung Galaxy M01
Samsung Galaxy M01

8,999

Samsung Galaxy M11
Samsung Galaxy M11

10,999

Infinix Hot 9 Pro
Infinix Hot 9 Pro

9,999

LG Velvet
LG Velvet

Price Not Available

Xiaomi Mi Note 10 Lite
Xiaomi Mi Note 10 Lite

Price Not Available

Apple iPhone SE 2020
Apple iPhone SE 2020

42,500

Honor 30 Pro
Honor 30 Pro

Price Not Available

Honor 30
Honor 30

Price Not Available

OnePlus 8
OnePlus 8

44,999

OnePlus 8 Pro
OnePlus 8 Pro

54,999

Xiaomi Redmi Note 9 Pro
Xiaomi Redmi Note 9 Pro

13,999

Motorola Moto E4
Motorola Moto E4

8,999

Samsung Galaxy On Max
Samsung Galaxy On Max

9,775

nubia N2
nubia N2

15,999

Karbonn K9 Kavach 4G
Karbonn K9 Kavach 4G

5,290

Motorola Moto C Plus
Motorola Moto C Plus

6,999

Best Sellers