This article is part 4 of an ongoing series, catch up on Part 1, Part 2 and Part 3 hereUnderstanding depth and volume is crucial when designing for Augmented Reality. We experience the world in more than one dimension and need to design accordingly. In this article, Ill shine a light on what 3D means in Augmented Reality.
We will take a look at the components of a 3D scene, how the underlying technology works, and methods for producing 3D objects. This article is ideal for readers who want to:Create their own 3D content for ARLearn how to source 3D contentHave a better understanding about the current landscape for 3D.How can designers start learning 3D?
For many years, 3D had an impossibly high barrier of entry for designers. Its long been considered a technical medium reserved for industries like visual effects, video games, and medical illustration. Adoption in design has been further blocked by a steep (and rocky) learning curve, poor user experience, and prohibitively expensive entry fees.
As the need for designers with 3D skills skyrockets, however, new initiatives are emerging to make learning 3D easy, accessible, and fun for designers. One such initiative is 3D for Designers, which has become the de facto starting point for designers and illustrators who want to add 3D to their toolkit. Created and taught by design industry veteran Devon Ko, it includes both free lessons and a comprehensive 3D design fundamentals course.
If you want to learn shape, form, lighting, color, and animation in 3D, I highly recommend starting here. Disclosure: Devon helps me edit this Augmented Reality on Mobile series, and Im a Teaching Assistant in her course Composition of a 3D SceneA 3D scene is composed of several objects and things that exist in x,y and z space. Some of the more common objects you will find in a scene are as follows:Mesh: A collection of points, edges and faces that describe an object.
e.g.: A 3D mesh of a sphereCamera: A fixed viewpoint, as of that from a camera.
e. g. : A view that is always fixed on the sphere no matter where it goes.
Light: A source of illumination that creates light and shadow in the scene.e.g.
: A spotlight that only exposes something in the middle of a scene. Material: contains information about how an object looks, including color, texture, and density.e.
g.: A sphere that look like its made out of wood.Shader: Similar to a material but contains procedural data about how an object should look.
e. g. : Creating the effect of electricity zapping away a sphere.
A 3D file may also contain additional data such as animation and rigging information. A mesh by itself or with additional data is also referred to as a 3D model. Pre-Rendering vs Real-Time RenderingRendering is the process of interpreting 3D scene data into a graphic.
Traditionally, 3D software has a render preview mode that can be activated to see a (typically) lower-quality preview of the final render. Depending on the hardware and complexity, a single frame can take a few seconds or even days to render. AR as a medium cannot afford a few seconds or days to show content.
This medium requires the rendering to always be done instantly and in real time and therefor requires a real-time rendering solution.A real-time renderer is capable of displaying and updating information immediately. Examples of real-time renderers are Unity or Eevee.
For a real-time experience to feel smooth, the frame updates should take place at about 60 frames per second (60 fps). Keeping an eye on the fps ensures that the experience mimics the real world. Common 3D content typesThere are several types of 3D extensions and formats, some are exclusive to their authoring environment whereas others are open source.
The following are common and emerging formats:Object File (.obj): This is the most common and basic type of 3D file, it contains only the geometry information of an object. Most .
objs are accompanied with an . mtl (material library file) that contains information about the material and textures.Filmbox (.
fbx): This file format stores more than just geometry and includes scene, camera, lighting, rigging and other 3D information. It does not include textures but may sometimes have base surface color. This format is maintained by Autodesk.
Collada (. dae): Similar to . fbx, but maintained by the open source community.
Graphics Library Transmission Format (.glTF): The self proclaimed JPEG of 3D, glTF is an open source 3D file format supported by The Khronos Group. It can carry a diverse amount of data specially created to meet the emerging needs of web and mobile 3D.
It is functionally similar to an . fbx but much smaller in size. Universal Scene Description ZIP (.
USDZ): This is a zipped version of a . USD file, a format developed by Pixar to include robust and interchangeable data into a single file format. This means that you can have variations of an object in the same model instead of having several models.
So whats the best file format for AR?The challenge with loading 3D objects into an AR application is that it needs to be done immediately and in real-time. The best file format is one that loads and performs as fast as possible, and thats the goal of both .
glTF and .USDZ.The major conflict between these formats is that the industry has divided itself in terms of support.
For example, Apple exclusively supports and encourages the use of . USDZ for ARKit applications, however Chrome does not support this format on the web and promotes .glTF.
If you are considering commissioning or buying a 3D asset, my recommendation would be an .fbx since you can covert it into both .glTF and .
USDZ based on your needs.Constructing a 3D object3D models are constructed in two primary ways: sculpting and modeling. Figuring out the type of object you need first will determine the software or artist that is right for the task.
Sculpting: The act of deforming polygons with a brush point, similar to working with clay. This method is best for organic shapes like figures and animals. The most popular software specialized for this type of work is ZBrush and Mudbox.
Modeling: Controlling every point with precision, similar to working with vectors. This method is best for hard surfaces like machines and architecture. 3D tools such as Blender, Maya and Cinema4D are capable of both types of authoring.
Whichever process is chosen, it will ultimately create a mesh. A mesh is simply a collection of points, edges and faces that help describe a 3D object in space. These points, edges and faces combine to form polygons.
The higher the polygon count, the smoother your 3D model will look. A higher polygon count may also impact performance and load times. This is one of the main reasons current AR games do not look as high fidelity as a game designed for a console.
Sometimes, instead of creating a high polygon count mesh, a material can act as a way of introducing the same amount of detail but with a faster load time.MaterialsTheres a misconception that materials are like a layer of paint on an object. Materials are more like upholstery, they have structure and properties within themselves and can even influence the shape of a model.
They can also exist separately from the mesh and be reused. The most popular tools for authoring materials are Substance Painter and Substance DesignerUV Map: When a material is applied to an object, the UV map is one way to define how it is projected on the mesh. For example, if a flat texture of the earth is applied to a sphere, without a UV map it would look like all of the continents are squished into one spot.
In some cases a purchased model may not look correct, oftentimes because the materials are missing or the mapping is incorrect.Engine Specific MaterialsNot all renderers are the same, in fact, each rendering engine will have unique characteristics that will impact how something looks. For example, purchasing a model with V-Ray materials will only work if you are using the V-Ray renderer.
A material may not be the only thing that affects how your model looks, the following list of properties can also influence the visualization of an object.LightingLighting does more than just brighten a dark scene, its the secret to making something look like it belongs in an environment. Incorrect lighting is one of the most obvious visual discrepancies a viewer can pick up on.
Lighting can sometimes also have a greater impact on the color of an object than the materials themselves.For lighting to be believable, it needs to be accompanied by the right shadows. Our eyes are trained to recognize where an object is in space based on the cues that shadows provide.
For example, natural light from the sun casts stronger directional light and shadows than artificial light.Some models come with a lighting rig which is a set of lights that mimic different studios or setups. These setups can be static or animated and can have different properties.
Sometimes the lighting can be defined by a 360 image, these are called Image Based Lights (IBL) and are a cheap solution for creating realistic lighting.Many AR services use a method called lighting estimation to generate more realistic lighting and shadows. This is a method of using computer vision to understand the world around the user and then generate the correct lighting setup.
This process is similar to an IBL and is constantly analyzing information so it can update to match any new changes that take place.3D ScanningWith the advancement of cameras and sensors on phones, 3D scanning is starting to pick up momentum as a viable way of generating content from a phone. One of the most common methods of scanning is using photogrammetry.
An application like Meshroom can take image data from your phone and help generate a mesh so you have a 3D model.At this moment 3D scanning via phones still has some way to go since the mesh is not 100% accurate. If you do go this route, be prepared to clean up the materials and the mesh that gets generated.
The good news is that mobile device manufacturers are continuously investing in better hardware and sensors, which will in turn enable even more precise scanning in the future. A time when you can instantly scan a production ready 3D asset might not be that far away. ResourcesThere are several resources that can help make it easier to get the right 3D content.
Here are a few recommendations:Art Station: A resource and community for sharing work and finding professional 3D artistsTurbosquid: A paid stock site with some of the most extensive offerings of 3D models and textures.Google Poly: Thousands of free 3D assets optimized for AR/VRSketchFab: A web based service and community for viewing 3D models and finding artistsUnity Asset Store: A large offering of paid and free 3D models and extensions optimized for a real time engine. Mixamo: A free web service that automatically rigs biped models.
In part five I will explore tips and tricks from the visual effects (VFX) industry that can help craft more realistic and compelling AR experiences.Thanks always to Devon Ko for the editing and Tony Parisi, Jeremy Cowles and Brendan Ford for the insights. RELATED QUESTION Can a stroke patient hope for a 100% recovery rate after 3 years?
It is not 100% guaranteed that a stroke patient would recovery completely after a certain period of rehab therapy, however, according to American Stroke Association, rehabilitation is the only effective way to recover from stroke sequelaes, such as foot drop and arm paralysis problems.To regain the health and fitness, patients can choose a home-used therapy machine so that they can do rehabilitation training at home whenever they want, maximizing the utility of recovery process.Here are two of the latest and most innovative stroke rehabilitation equipments recommended:H1 Hand Rehab System2.
G3 Foot Drop System.
If you have a question, please contact at contact info@mecanmedical.com
{"site":{"site_id":2622,"site_type":1,"site_domain":"medical-hospital-equipment.com","domain_mode":2,"original_domain":"medical-hospital-equipment.com","language_code":"en","is_init_domain":0,"is_shop":false,"is_ssl":1,"lang_prefix":"/","animate_name":"none","compress__ratio":"75,60,60"},"page":{"page_id":40577,"page_type":"ai_article_detail","page_code":423,"page_url":"/ai-article/a-quick-guide-to-designing-for-augmented-reality-on-mobile-part-4.html","page_source":"","allowAnimat":0,"content_id":299,"content_type":5,"detail_thumb":"https://img.yfisher.com/1615810342102.jpg","detail_title":"A Quick Guide to Designing for Augmented Reality on Mobile (Part 4)","moq":1},"translateList":{"A new item has been added to your Shopping Cart":"A new item has been added to your Shopping Cart","account":"account","Account Name":"Account Name","Account Number":"Account Number","Account is not exists":"Account is not exists","account security":"account security","Active Commission":"Active Commission","Add a review on the product":"Add a review on the product","Add to":"Add to","Add to Cart":"add to cart","address book":"address book","affiliate links":"affiliate links","all":"all","All Orders":"All Orders","Already commented":"Already commented","Are you sure to cancel this withdrawal?":"Are you sure to cancel this withdrawal?","Are you sure to delete the selected items?":"Are you sure to delete the selected items?","Are you sure you want to delete it?":"Are you sure you want to delete it?","Awaiting Payment":"Awaiting Payment","Awaiting Shipment":"Awaiting Shipment","Back":"Back","Bank Transfer":"Bank Transfer","bank address":"bank address","basic information":"basic information","Buy":"Buy","Buy Now":"Buy Now","bank name":"bank name","city":"city","Copy successful":"Copy successful","Copy failed":"Copy failed","Can Extract":"Can Extract","Currency Type":"Currency Type","Cancel":"cancel","Cancel the success":"Cancel the success","Cancelled":"Cancelled","Choose a country":"Choose a country","Choose Coupon":"Choose Coupon","Choose items":"Choose items","Clear":"Clear","Clear Search":"Clear Search","Comment Successful!":"Comment Successful!","Comment Failed!":"Comment Failed!","Commission Details":"Commission Details","Commission":"Commission","Commission Status":"Commission Status","commodity payment":"commodity payment","completed":"completed","Completed":"Completed","Condition not met":"Condition not met","Confirm":"Confirm","Confirm password is inconsistent with new password":"confirm password is inconsistent with new password","Congratulations":"Congratulations","Congratulations! You are got a coupon.":"Congratulations! You are got a coupon.","Congratulations! You are got all coupons.":"Congratulations! You are got all coupons.","Continue":"Continue","Continue Shopping":"Continue Shopping","Copy the code and use it directly in the shopping cart.":"Copy the code and use it directly in the shopping cart.","Country":"Country","Coupon code":"Coupon code","Coupon List":"Coupon list","Date":"Date","days after receiving":"days after receiving","Design customization":"Design customization","Do not use any discount":"Do not use any discount","Earliest":"Earliest","Export successful":"Export successful","Export failed":"Export failed","email":"email","email format does not match":"email format does not match","Estimated Delivery Time":"Estimated Delivery Time","Effective Order Count":"Effective Order Count","Effective Sale Amount":"Effective Sale Amount","Expense":"Expense","expired":"expired","export a report?":"export a report?","Failed to upload files.":"Failed to upload files.","FAQ":"FAQ","Find Parts":"Find Parts","for order over":"for order over","Free":"Free","Free Quote & Information Request":"Free Quote & Information Request","Free Shipping":"Free Shipping","Get":"Get","Get coupons":"Get coupons","Get discount":"Get discount","Get it":"Get it","Get it after logging in and use it in the shopping cart.":"Get it after logging in and use it in the shopping cart.","Go to Page":"Go to Page","Highest Price":"Highest Price","home":"home","Hot Sale":"Hot Sale","Income":"Income","Incorrect form format":"Incorrect form format","inquiry":"inquiry","join guide":"join guide","Last 30 days":"Last 30 days","Last 7 days":"Last 7 days","Links report":"Links report","Loading":"Loading","Lowest Price":"Lowest Price","Match Product":"Match Product","Merchant Free Shipping":"Merchant Free Shipping","message":"message","Most Popular":"Most Popular","my account":"my account","my coupons":"my coupons","my inquiry":"my inquiry","my orders":"my orders","my reviews":"my reviews","my wishlist":"my wishlist","name":"name","New Arrival":"New Arrival","Newest":"Newest","No Quotation":"No Quotation","No time limit":"No time limit","Not deleted":"Not deleted","not valid yet":"not valid yet","Off":"Off","Offers and Discounts":"Offers and Discounts","ok":"ok","Only DOC,DOCX,PDF,PNG,JPEG and JPG files can be uploaded":"Only DOC,DOCX,PDF,PNG,JPEG and JPG files can be uploaded","optional":"optional","order notes":"order notes","Order over":"Order over","order id":"order id","order status":"order status","order amount":"order amount","Orders Report":"Orders Report","Other":"Other","Password contains at least numbers and letters length should be 6-20":"password contains at least numbers and letters length should be 6-20","Password is invalid":"Password is invalid","Password length should be 6-20":"Password length should be 6-20","Paypal":"Paypal","paypal payment":"paypal payment","Pending":"Pending","Pending Commission":"Pending Commission","personal info":"personal info","Please click ’click to continue’ to retry.":"Please click \"click to continue\" to retry.","Please contact customer service for cash withdrawal":"Please contact customer service for cash withdrawal","Please enter a valid email address":"Please enter a valid email address","Please enter the verification code":"Please enter the verification code","Please login in first":"Please login in first","Please select attribute":"Please select attribute","Please select country/region":"Please select country/region","Please select superior":"Please select superior","Please select the number of ratings.":"Please select the number of ratings.","Please select your country":"Please select your country","Please upload the invoice file":"Please upload the invoice file","Processing":"Processing","Product Name":"Product Name","Please fill in the delivery address before selecting the payment method":"Please fill in the delivery address before selecting the payment method","promotion center":"promotion center","Promotion Link Click Amount":"Promotion Link Click Amount","Promoted link clicks":"Promoted link clicks","Promotion Order Count":"Promotion Order Count","Promotion Reports":"Promotion Reports","read more":"read more","Received commission":"Received commission","Refund":"Refund","Refuse":"Refuse","Region":"Region","Register Success":"Register Success","Remittance":"Remittance","Reviews":"Reviews","reports":"reports","Sale ends in":"Sale ends in","Save in wishlist":"Save in wishlist","Search":"Search","swift code":"swift code","Select how to share":"Select how to share","Select premium items to increase your chances of making money":"Select premium items to increase your chances of making money","Share items to your channels.when other purchase a from your link, you can get commission.":"Share items to your channels.when other purchase a from your link, you can get commission.","Share Product":"Share Product","shipment successful":"shipment successful","Shipping":"Shipping","Shipping Address":"shipping address","Size guide":"Size guide","Small Text":"Small Text","Small Title":"Small Title","Sort By":"Sort By","Sales Amount":"Sales Amount","State/Province/Territory":"State/Province/Territory","Successfully delete":"Successfully delete","Successfully save":"Successfully save","Thank you for trying":"Thank you for trying","The account has been deactivated, please contact customer service to activate":"The account has been deactivated, please contact customer service to activate","the content can not be blank":"the content can not be blank","The coupon code has been copied and used in the shopping cart.":"The coupon code has been copied and used in the shopping cart.","The file name cannot exceed 100 characters":"The file name cannot exceed 100 characters","The file size cannot exceed 2MB":"The file size cannot exceed 2MB","The number of withdrawals on the day has been capped":"The number of withdrawals on the day has been capped","The subscription is successful, thank you for your participation":"The subscription is successful, thank you for your participation","The user center is out of service. Please contact customer service":"The user center is out of service. Please contact customer service","There is no amount to withdraw":"There is no amount to withdraw","There is no data to export":"There is no data to export","This is Text":"This is Text","This is title":"This is title","This transaction has failed.":"This transaction has failed.","Time to shop":"Time to shop","Tips":"Tips","To be commented":"To be commented","Total":"Total","Tutorial":"Tutorial","This Supplier/Shipping Company does not deliver to your selected Country/Region.":"This Supplier/Shipping Company does not deliver to your selected Country/Region.","Update password success":"Update password success","Upload Image":"Upload Image","Upload up to 6 pictures":"Upload up to 6 pictures","uploading":"uploading","used":"used","user center":"user center","Upload Invoice":"Upload Invoice","valid now":"valid now","Validity period":"Validity period","View Cart & Checkout":"View Cart & Checkout","views":"views","Valid for":"Valid for","Welcome to the website":"Welcome to the website","Western Union":"Western Union","When your buyers received and confirmed orders, you can get commission right now!":"When your buyers received and confirmed orders, you can get commission right now!","Withdrawal":"Withdrawal","Withdrawal success":"Withdrawal success","Withdrawal Method":"Withdrawal Method","Write a Review":"Write a Review","Withdrawal Amount":"Withdrawal Amount","Yes":"Yes","Yesterday":"Yesterday","You are clicking too fast":"You are clicking too fast","You are got a coupon.":"You are got a coupon.","You can select a maximum of 90 days":"You can select a maximum of 90 days","You can withdraw the commission to your Paypal account.":"You can withdraw the commission to your Paypal account.","You haven’t chosen an address yet":"You haven't chosen an address yet","You haven’t selected a product yet":"You haven't selected a product yet","Your rating":"Your rating","Your review":"Your review","Your shipping address error":"Your shipping address error"}}