{"id":166199,"date":"2023-02-01T15:08:38","date_gmt":"2023-02-01T07:08:38","guid":{"rendered":"https:\/\/facfox.com\/docs\/?post_type=kb&p=166199"},"modified":"2023-02-01T15:08:38","modified_gmt":"2023-02-01T07:08:38","slug":"3d-photoscan-with-a-phone-camera-and-object-capture-photogrammetry","status":"publish","type":"kb","link":"https:\/\/facfox.com\/docs\/kb\/3d-photoscan-with-a-phone-camera-and-object-capture-photogrammetry","title":{"rendered":"3D Photoscan with a Phone Camera and Object Capture \u2013 Photogrammetry"},"content":{"rendered":"

One of the convenient ways to 3D scan objects or the scenery is by taking pictures from all angles using a mobile phone camera, what\u2019s known as photogrammetry or a 3D photoscan. The images are then uploaded into a photogrammetry software for processing. After a clean-up, hopefully, a quick one, the end result will be a 3D printable or ready for AR object. Also, it is possible to achieve a highly textured and rich-colored object with a stunning 3D view. The results may not be far from what the professionals achieve in their animation for games and 3D movies.<\/p>\n

Of course, those who use expensive equipment like cameras with multiple lenses and process the results in a licensed software, may get better results and spend much less time for post-processing the images. In this article, we will focus on what is possible to achieve by a casual user who wants to try photogrammetry for free\/affordably with tools at hand.<\/p>\n

Photogrammetry \u2013 Capture Now \u2013 Process Later<\/h2>\n

Zebra. Once on holiday, knowing the basics of photogrammetry, I captured a beautiful zebra (imitation) using my mobile phone. It was a very nice experience and time well-spent in the fresh air in a park.<\/p>\n

\"\"
3D Photoscan result of a zebra \u2013 texture and a pre-clean-up model (Image: 3DWithUs)<\/figcaption><\/figure>\n

For a few years, I\u2019ve been putting off processing the images, and my free Autodesk ReCap Photo (previously ReMake) 30-day trial expired. I liked using the ReCap software when processing the Dolphin Standard for the\u00a0Scan the World<\/a>, but paying a subscription fee for a rare casual photoscan doesn\u2019t work for me. To my delight, I achieved a surprisingly good result when I uploaded zebra images to Meshroom, a free photogrammetry software. Now I have a beautiful zebra model. A 3-year-old photo set didn\u2019t go wasted.<\/p>\n

\"\"
The Dolphin Lamp Standard was captured using a mobile phone camera, processed in Autodesk Re-Cap, and further reconstructed in Meshmixer.<\/figcaption><\/figure>\n

Photogrammetry Tips & Tricks<\/h2>\n

Before going further, the first thing we have to learn is taking the pictures for the photogrammetry software. Here are some tips and tricks:
\n\u2013 The amount<\/strong>. At least 50+ depending on an object. As I mentioned earlier, capture now \u2013 process later. Some pictures may be blurry, as we are using the mobile camera, and then the photogrammetry processing software may reject without a known reason (for a casual user), so the more the merrier.
\n\u2013 Stable object.<\/strong>\u00a0Make sure that your object stays still and is not shaking, changing position while taking the pictures. If the object is accidentally moved during the photo session, it\u2019s better to start all over.
\n\u2013 For shiny or reflective objects<\/strong>, the only way to capture them is to make them stop reflecting the light. To achieve this, cover them temporarily in some matt solution. Otherwise, the photogrammetry software will be confused, and the photoscan will fail.
\n\u2013 Focus<\/strong>\u00a0and capture all pictures manually. Use the Open Camera app for mobile phones.
\n\u2013 Consistent light.<\/strong>\u00a0On and off sunshine during capturing your object may also confuse the software. The best 3D photoscans with a mobile phone can be achieved outside but it should be in the consistent lighting. A cloudy day is better as there are no shadows that may cause a problem. If the object has a lot of shadows, pay extra attention to the places affected and take more pictures.<\/p>\n

Turntables \u2013 Poor Results When Using a Mobile Phone<\/h2>\n

Photogrammetry software greatly benefits from mapping the environment by measuring the distance between the object and points in the environment. In case of a turntables, the location of the object pointers keeps changing, which causes a big mess for the processing software.
\nHere are a few pointers on how to achieve good results with a professional photo camera.
\n\u2013 Consistent lighting.<\/strong>\u00a0Mini LED-lit studios, for it not to recognize any other points around the object.<\/p>\n

\"\"
Turntable photogrammetry with DSLR camera. Creating a void background. (Photo: Andrew Sink)<\/figcaption><\/figure>\n

\u2013 Consistent void.<\/strong>\u00a0Black matt blanket and clear focus, again, for it not to recognize any other points around the object. Check how Andrew Sink creates a\u00a0void background to 3D capture an apple by using photogrammetry<\/a>\u00a0and Agisoft Metashape software.
\nSo basically, in both cases above, there are attempts to trick the photogrammetry software into believing that we are actually going around capturing the object.<\/p>\n

Photogrammetry Software<\/h2>\n

Processing the bulk of images involves a lot of data, and because of this, the more powerful the computer is the quicker it deals with the processes involved. In some cases, laptops or other PCs are better to be left alone during the processing in order to avoid the crash, and it may take a while.
\nOther software that involve cloud are installed on the PC, but for the most difficult task \u2013 the processing \u2013 all images are uploaded to the cloud. After this a 3D object becomes available locally for the cleaning, editing and exporting.<\/p>\n

\"\"
Photoscan of a loaf of bread using the Samsung Android mobile phone. Then selected images were processed in Meshroom photogrammetry software. (Image: 3DWithUs)<\/figcaption><\/figure>\n

Meshroom \u2013 Free, Open-Source, 3D Reconstruction Software<\/h3>\n

NB! Software is dependent on Nvidia (CUDA-enabled GPU) graphics cards.
\nAfter briefly trying a few other free\/affordable 3D scanning related software, I stopped on the\u00a0Meshroom<\/a>, which struck me with a straightforward interface. Everything is presented on the same screen, and the whole software tutorial can be done by using a single screenshot below.<\/p>\n

\"\"
Meshroom photogrammetry software straightforward interface (Image: Meshroom)<\/figcaption><\/figure>\n

1) Load the images.
\n2) Press the \u201cStart\u201d button.
\n3) Wait patiently. Depending on the number of images to load, the quality, and your computer capabilities, it may take over 3 hours to process.<\/p>\n

When the processing is completed, you will see the \u201cLoad\u201d button in a 3D viewer section. Don\u2019t be put off when you see a lot of debris. It is easy to clean those up using Meshmixer or Blender. The only place where I got confused was how to export an .obj file as there was no \u201cexport\u201d button on the interface. To find the .obj file, go to the Meshroom Folder \u2013 MeshroomCache \u2013 Texture. Then open a folder with a very long name.<\/p>\n

So far so good, and if you need just an .obj file for 3D printing then the next step is Blender or Meshmixer for the\u00a0clean-up<\/a>. And if you want to upload a beautifully textured model to Sketchfab, please mind that there is a limit for the file size. Sketchfab accepts files of max. 50 MB.<\/p>\n

\"\"
Load button and nodes in the Meshroom software (Image: Meshroom)<\/figcaption><\/figure>\n

To help with the cleaning and the file size reduction process, I found a detailed\u00a0Meshroom tutorial on the Sketchfab<\/a>\u00a0by YANN LANTHONY, which was very useful. By following the \u201cDecimate Mesh\u201d and \u201cAdjusting Parameters\u201d instructions step by step, I managed (using nodes) to reduce the file size of my Loaf of Bread from 120 MB to 18 MB. Click and rotate the model in Sketchfab view.<\/p>\n

Cleaning up, patching, and getting ready for 3D printing can be done in Blender or Meshmixer. In Blender 2.8 \u201cEdit mode\u201d select all surrounding debris with a lasso selection, delete them, patch the holes, and export as STL. For AR (Augmented Reality) check the Sketchfab uploading tips.<\/p>\n

As any 3D design for 3D printing creator, I have some experience in uploading STL files to\u00a0file repositories<\/a>. Uploading a .obj file with the high textured 3D view onto Sketchfab may feel a bit tricky and may take a few attempts until it is done in the right way. To successfully upload a model with textures you have to send all files, for example, .obj, .mtl, .png together in a zipped folder.<\/p>\n

I had some issues with the textured PNG images. Such images can be 30-40 MB each. So the next task is to locate them and reduce in size. These are situated in the same folder as .obj and .mtl. To scale the images, I played around in GIMP.<\/p>\n

Autodesk ReCap Photo<\/h3>\n

Free trial and then $50 p\/m\u00a0Autodesk ReCap Photo<\/a>\u00a0photogrammetry software deals with difficult, data-rich (2-3GB sometimes) task like a boss. And it does it via the cloud.<\/p>\n

\"\"
3D Scanned MonkeyPuzzle Tree Trunk in Autodesk ReCap Photo (Image: 3DWithUs)<\/figcaption><\/figure>\n

We mentioned Autodesk ReCap Photo (previously known as ReMake) in one of our blogs. We used this software to create a GW2 cannon\u00a03D scan from the in-game screenshots<\/a>. We also filled our\u00a03D Scanned Tree Texture Gallery<\/a>\u00a0with the new models of the tree trunks with the help of ReCap Photo.<\/p>\n

\"\"
3D Scanned with a Mobile Phone Camera \u2013 3D Printed Tree Textures (Image: 3DWithUs)<\/figcaption><\/figure>\n

What is Object Capture? Emerging Apps for iPhone and Mac Users<\/h2>\n

Object Capture is an API (Application Programming Interface) introduced by Apple. Basically, it is photogrammetry made easier for the iPhone and Mac users, and apparently other Apple products in the future. iPhone users can use their phone camera to capture approx. 50+ images the way we recommend in Tips & Tricks section, by following all\u00a0basic photogrammetry rules<\/a>, and then emerging apps in Mac will turn these images into a 3D object in USDZ format. And such applications already exist:<\/p>\n

PhotoCatch<\/h3>\n

Shortly after Object Capture was introduced, Ethan Saadia developed a\u00a0PhotoCatch<\/a>\u00a0application for Mac computers. PhotoCatch can turn a photo set or video taken by iPhone into a 3D object in minutes. Then it is possible to view and share the model in AR\/VR.<\/p>\n

Polycam<\/h3>\n

Another interesting app to add here is\u00a0Polycam<\/a>. We have already mentioned Polycam application as one of the\u00a0LiDAR scanner apps<\/a>. Polycam has now a\u00a0Photo Mode<\/a>\u00a0option next to a LiDAR option. Photo option enables the processing of 20-200 images in a photogrammetry (Apple\u2019s Object Capture) in the cloud. A convenient all-in-one functionality.<\/p>\n

\"\"
Stone Pillar captured with Polycam \u2013 LiDAR vs Photo Mode \u2013 Mesh Difference (Image: 3DWithUs)<\/figcaption><\/figure>\n

Good news for Android phone users. According to Polycam, an Android version of the application with the Photo Mode feature is expected to be released by the end of this year.
\nPhoto Mode is powered by Apple\u2019s Object Capture. It could definitely be used with an Android device since the mobile device is just uploading to a computer that does the actual reconstruction. We have plans to create an Android version by the end of the year.<\/em>
\nQuote by Elliot (Polycam) via Discord.<\/p>\n

\n

Polycam for Web<\/h3>\n

Photosets taken by Android, DSLR, or other non-Apple devices can now be uploaded to the cloud for Object Capture photogrammetry to process thanks to the Polycam for Web browser-based feature.<\/p>\n<\/div>\n

<\/p>\n

Up to 250 images that are taken following\u00a0basic photogrammetry rules<\/a>, after uploaded and processed, are turned into a 3D Capture. Captures can then be shared with the community and on social media. Also, a mesh of the 3D Capture can be downloaded in the OBJ, GTLF, FBX, DAE, STL formats for further cleaning and editing.<\/p>\n

By following the #objectcapture hashtag on Twitter, we saw a lot of impressive 3D models together with the praise, particularly about the good processing speed. A blog about Object Capture is coming soon.<\/p>\n

Clean up .obj File and Get it Ready for 3D Printing or High-Quality 3D View<\/h2>\n

Photogrammetry with post-processing and clean-ups is still unbeatable in terms of quality. Various\u00a03D scanning smartphone apps<\/a>,\u00a0LiDAR apps<\/a>\u00a0are more convenient in terms of speed than quality. For more details please check our existing blogs.
\nCleaning up, patching, and getting ready for 3D printing or high-quality 3D view can be done in\u00a0Blender<\/a>\u00a0or\u00a0Meshmixer<\/a>. In Blender 2.8 \u201cEdit mode\u201d select all surrounding debris with a lasso selection, delete them, patch the holes, and export as STL or export as OBJ with MTL and PNG files to preserve texture skins (bakes).<\/p>\n

Check the course by PTT, if you need to learn 3d design for 3D printing basics. Here is a detailed\u00a0review of the Blender 2.8 for 3D printing<\/a>.<\/p>\n

3D Scan Friendly File Repositories<\/h2>\n

\u2013 Sketchfab.<\/strong>\u00a0At the moment of writing this post,\u00a0Sketchfab<\/a>\u00a0stays unbeatable in terms of 3D scan friendliness. But there are some upload rules.
\nAs any 3D design for 3D printing creator, I have some experience in uploading STL files to file repositories. Uploading a .obj file with the high textured 3D view onto Sketchfab may feel a bit tricky and may take a few attempts until it is done in the right way. To successfully upload a model with textures you have to send all files, for example, .obj, .mtl, .png together in a zipped folder.
\n\u2013 MyMiniFactory.<\/strong>\u00a0MyMiniFactory<\/a> curated initiative Scan the World created a great repository of 3D printable models. In a big part, such models became available thanks to photogrammetry.<\/p>\n

Photogrammetry for 3D Printing<\/h2>\n

On this website, you will find a lot of quality blogs covering\u00a03D scanning<\/a>\u00a0generally. Read about mobile phone photogrammetry,\u00a0iPhone and Android 3D Scanning Apps<\/a>, software reviews,\u00a0LiDAR Apps<\/a>\u00a0etc. Also, you can find striking 3D models and their 3D print collections achieved thanks to these technologies and techniques described in\u00a0Scan The World<\/a>\u00a0and 3D Scanned\u00a0Tree Textures<\/a>\u00a0articles and galleries.<\/p>\n

In the YouTube video below we briefly show the way to transfer the texture of any tree to a 3D printable object. It is possible to achieve this using just a mobile phone camera, photogrammetry software like Meshroom, and 3D design software like Blender3D for texture cleaning for further editing.<\/p>\n