Answered

Ability to edit textures / remove Matterport from mirrors.

Many of us our photographers and we would love the ability to download textures and replace them. This would resolve the issue that many of our customers have with not wanting to show the Matterport camera in mirrors.

24

Comments

25 comments
  • Interesting! When you mentioning downloading and replacing textures, are you talking specifically about the mirrors? Or are there other instances/needs in addition to not showing the Matterport camera in mirrors?

  • I'm mainly focused on mirrors for myself, although I could imagine other MSPs being interested in being able to do things like blur sensitive information if needed or remove something they forgot to take out of a scene. I don't know if the panoramas are saved as single images, or in tiles -- which is why I simply referred to these as 'textures' :)

  • I also think of fixing special stitching errors in the 360 full panorama pictures.
    Especially in restaurants with a lot tables the stitching works really bad and the result is not sellable at all. Without an option to fix these errors with Photoshop I think a lot of money is lost, not to speak of the image value.

    Currently capturing with Matterport is often like playing russian roulette. That´s fine for private, but not for business.

  • We would be very interested in this for scanning the inside of vehicles & motorhomes. This would mean we don't have to move the vehicles into a sterile environment so it looks nice out of the window. It would be great to be able to add our clients branding to the windows.

  • I agree! We have several clients who complain about the camera reflecting in mirrors when there is no way to get around the camera position. It would be a GODSEND to simply be able to mark a section as a mirror and do a matte blur or something. Please PLEASE add this feature!!!

  • I have very mixed feelings about this issue. So far I haven't had any problems with my clients regarding the mirrors being present. They have asked, and I've explained it is What You See Is What You Get - and when a client sees a camera reflection - it's a high tech camera like they've never seen before. So far it's worked well.

    I understand the desire to have the capability, and it would be good on high profile scans. My biggest concern is the amount of time spent on 'fixing'. What about all the window, picture glass, sunlit camera shadows that appear? The beauty of this product is that I don't have to spend hours after the shoot working on the Space. And once an agent/client knows that the mirror can be erased - they will want it gone from all reflections, not just the mirrors.

  • This is a really great point. The stitching errors in the 360s are bizarre. You would think that an automated panoramic camera would have ZERO stitch errors. I think that requesting the ability to correct panoramas due to this makes sense.

  • Agree! Currently capturing with Matterport is often like playing Russian roulette. That´s fine for private, but not for business. I am having lots of trouble cause there is no preview of the stitching. I have to scan 8 airplanes and 1 FBO again because of this issues. Please provide what we ask and need!

  • Anyone dare me to make a proof of concept? :)

  • If, for each reflection occurred in a space that we would like to fix, from Workshop we could e.g. click a point in a shot indicating the center of the (reflected) camera, it could be quite possible for an intelligent software (image recognition, with maybe a pinch of deep learning) to recognize the shape of the reflected camera, contour it, expand the contour with some good amount of feather, and apply a content-aware fill algorithm (similar to the one built-in in Photoshop, or maybe the Resynthesizer Gimp plugin) into that feathered shape.

  • If matterport allowed us to download the cube faces, we could just edit out the camera and reupload the files. it's that simple.

    If they want to moderate this because they don't want to give us our images, we could flag the scene and they could grant us download access to only the necessary cubes.

  • Yes, of course. My suggestion of an automatic feature comes because probably Matterport doesn't want us to edit the cube faces as they wouldn't know the quality of our job on them (that's my guess: maybe there are more reasons).

    So making the process semi-automatic ("semi" is just because we would say which are camera reflections, then the software should get rid of them in the final image automagically) would keep the process consistent (make some straight actions, process, get result), and the quality of those reflections edits would just depend on Matterport.

    Of course if it was just you and me, i.e. people who know how to make something disappear in an image in a perfect convincing way, it would be simple as allowing us to edit those affected cube faces.

    But would you bet your kitchen table that everyone attempting that kind job would produce good enough results, or even be aware of a not-good-enough result? I'd mostly bet that in some cases I would judge the camera reflection to be better than the "fixed" view.

  • Antonio, I fully agree with you.

    I do want to interject a thought though... why does matterport need to care if we do a good job with our edits?

    I am extremely picky and as a developer, I always think about empowering my clients but not giving them enough rope to hang themselves with.

    I considered people submitting cubefaces saved with unreasonably high or low quality... People editing and adding inappropriate content... People extracting their panoramas to use on other services...

    And then I realized that one can scan a home and make bad decisions that create a low quality tour. One can catch themselves in the camera and leave it in the tour. One can graffiti profanity on walls.

    Someone could upload images that aren't optimized for display or file size. In the grand scheme of things it's no big deal.

    ---

    Google Street View detects faces and license plates for blurring... So the idea of blurring make sense. Clean removal? I think it's easier for matterport to just allow us to upload edited times

    ---

    Or! we can pay matterport to do it! They make money providing a service people want and control all aspects.

    It's simple!

    I have tested this by substituting files in local memory. It works flawlessly. Matterport just haven't offered this feature to us. The best way to approach any feature that people want is to see if it could be a product.

    All tours can be postprocessed with color correction and object removal. Keep asking matterport for it!

  • Antonio, I fully agree with you.

    I do want to interject a thought though... why does matterport need to care if we do a good job with our edits?

    I am extremely picky and as a developer, I always think about empowering my clients but not giving them enough rope to hang themselves with.

    I considered people submitting cubefaces saved with unreasonably high or low quality... People editing and adding inappropriate content... People extracting their panoramas to use on other services...

    And then I realized that one can scan a home and make bad decisions that create a low quality tour. One can catch themselves in the camera and leave it in the tour. One can graffiti profanity on walls.

    Someone could upload images that aren't optimized for display or file size. In the grand scheme of things it's no big deal.

    ---

    Google Street View detects faces and license plates for blurring... So the idea of blurring make sense. Clean removal? I think it's easier for matterport to just allow us to upload edited times

    ---

    Or! we can pay matterport to do it! They make money providing a service people want and control all aspects.

    It's simple!

    I have tested this by substituting files in local memory. It works flawlessly. Matterport just haven't offered this feature to us. The best way to approach any feature that people want is to see if it could be a product.

    All tours can be postprocessed with color correction and object removal. Keep asking matterport for it!

  • And thats why I say that Matterport doesnt really understand what Realtors want.

  • Hi Team, I also waiting for this feature for removing camera from mirrors ,because my clients don`t want to see camera in their projects. I may lost some important clients if this features were not implement. So please please help me.

  • The ability to post-process for color correction would be awesome.

  • Totally. ADD.

  • I have several clients who HATE seeing the camera in mirrors too. It's the #1 issue with the Matterport Platform. I've heard all sorts of excuses from MSPs like: "It's no secret that a camera was used, so it would be strange to not see it in a mirror." What a silly thing to say! There's nothing WORSE to interrupt the immersive experience of a Matterport tour than to SEE the camera.

    You know what would be VERY cool? If Matterport were to provide us with a few stick on vinyl sheets that their processing system could automatically detect (think green screen) and replace with textures -- or even allow us to provide a texture for. Their mesh system already has EXCELLENT filling capabilities, which demonstrates that Matterport could fix the mesh side of the vinyl sheets -- I'm sure that they could auto-generate a patch too and potentially allow us to replace it if we think we could do better.

    Matterport could also develop camera detection based on facial recognition services. APIs exist and while I have not investigated them, it makes sense that the Matteport Camera could be detected in a similar manner.

    https://www.microsoft.com/cognitive-services/en-us/face-api/documentation/overview

    Additionally, we could be provided a way to MARK the Matterport Camera -in- Capture. Or - as the Matterport Camera is based from similar software to a Kinect, I'm sure that facial recognition could be loaded into the camera software too.

    This library not only can scan the face (or Matterport Camera) but then detect it too. Just imagine the possibilities!

    https://github.com/mrosack/Sacknet.KinectFacialRecognition

    -

    On the flipside of all of this tech hypothesis -- imagine how fun it would be for Matterport to market that their system uses advanced facial recognition to remove the camera from mirror reflections?

  • Im a relatively new member to this community, but I have never had an issue with getting caught in a mirror because I go into a shoot prepping for that. Everytime I setup for a scan, I view from the angle of the camera as if I were scanning the room with my eyes. Glass shower doors, picture frames with plastic or glass surfaces that reflect, hallway mirrors, etc I can avoid by a few ways. Open the shower door, slightly angle the picture frame by sticking some foam on one side, angling the reflection the opposite direction, OR just not setup in front of it. I can also hide the camera really well outside on decks or patios by centering the camera inside a window pane or window casing.

    The other BIG one is bathrooms. I've yet to come across a bathroom that's totally impossible to NOT see the camera. Half baths are a breeze, setup the camera slightly inside the doorway and you can get almost a full idea of a bathroom without physically being inside of one, that works really well for me. As far as Master Baths are concerned, I'll typically start inside the doorway, then jump across the bathroom to avoid the mirrors. Whereas you may lose a place you'd prefer to stand, I don't want the potential client or buyer to have any possible chance of being distracted throughout their tour as to steal their attention or affection away from falling in love with a space.

  • All great techniques and thanks very much for sharing your expertise. I especially like the foam trick and slightly opening the shower door.

    I did just want to mention with master baths, or when you do run into larger mirrors that may pose a problem, it's not necessary to skip across the entire mirror in one jump. It may be better to capture a scan in between where the camera is reflected in the mirror just for alignment purposes, then move on to the next hidden scan. You can always hide that scan in Workshop and, who knows, maybe the client won't mind and will opt to keep the scan position live. Worst case, you can always remove it later if it's necessary. But, I just wanted to point out the extra scan as you're initially building out the model data can only help with alignment.

    Of course, as with any mirror it's critical a mirror marking is placed before scanning anything on the other side of the mirror :)

    Thanks again.

  • These are wonderful techniques.

    It is entirely possible to encounter scenarios where mirrors are not avoidable -- especially if you are scanning apartments wherein there's a bathroom with direct bedroom access that has a full length mirror behind the door.

    In this scenario, one would have to disable the scan outside of the bathroom with door open or try their best at a rather awkward diagonal path that would land you in front of the toilet. What's also not visible here is another mirror in the bedroom. The ability to edit panos to remove the camera from mirrors is a very important feature to my clients and myself as their MSP.

  • Has anyone tried to mount a mirror on the face of the camera yet?

  • would be nice to place a clients logo over the camera in the mirror.....

  • If there is a situation where the client would want this, you could print out their logo and tape it to the mirror during the shoot

    I am not being sarcastic, promise. I have considered this as well as keeping a box of props for different types of mirror camouflaging.

    The worst thing is going down a hall that ends in a T with a non movable mirror that is over six foot tall at the end.

Please sign in to leave a comment.