
Choose New Layer when Photopea Refine Edge must retain both its estimated transparency and its corrected foreground color. Raster Mask and Selection output preserve the transparency result but lose the newly estimated color. That is why a cutout can have a plausible boundary yet keep color contamination from the old background.
Identify the two parts of the edge problem
A blurred edge can contain both foreground and background color in the same pixel. Making that pixel partly transparent changes its contribution to the composite; it does not necessarily remove the old background color from its RGB value.
Photopea's Refine Edge explanation explicitly distinguishes the estimated transparency from the estimated new color. Its recommendation for New Layer output follows from retaining both, rather than from a universal claim that masks are inferior editing tools.
For a hypothetical warm-colored fabric against a blue backdrop, examine a soft edge. The desired result is not simply a more transparent blue fringe. It is a plausible fabric-colored edge with the appropriate partial visibility.
Mark foreground, background and uncertainty
Open Select > Refine Edge, or the Refine Edge control available from a selection tool. Photopea uses a trimap:
- White marks definite foreground.
- Black marks definite background.
- Gray marks uncertain edge areas for estimation.
If you begin with a selection, the initial trimap derives from that selection. Paint gray over imperfect boundaries; keep known interior material white and known background black. The Border control can generate a gray band around the initial selection.
Do not fill a broad region with gray merely to avoid making a foreground/background decision. The tool still needs meaningful evidence about which colors belong to which side.
Select the output that carries the required information
Inspect the result, then choose New Layer before confirming with OK. Keep the original source available underneath or separately, so the newly estimated colors can be compared with the recorded photograph.
If you instead choose Raster Mask or Selection, understand the tradeoff: the output carries the estimated visibility but not the newly estimated RGB colors. Refining the same outline repeatedly cannot repair a persistence choice that discards the color result each time.
For comparison, the hair-edge halo guide discusses the broader visible artifact. This guide isolates a specific Photopea output-mode cause rather than promising that one operation cures every halo.
Inspect the cutout over different backgrounds
As a proposed acceptance check, place the new cutout over a light and a dark test background. Inspect a fine edge and a broad opaque interior. Check whether the fringe still carries the old backdrop color and whether real subject color was changed undesirably.
Keep the layered cutout master separate from flattened delivery files. The test is whether the retained edge-color and transparency result serves the intended composite, not whether a mask thumbnail looks smooth.
Related tasks
- Export an Embedded Smart Object Without Exporting the Whole Poster
- Why Can I Edit My Saved Layers but Not Undo Yesterday’s Steps?
- What Is the Difference Between an Editable Artwork Master and a Flat PNG?
Sources and scope
- Photopea - Refine Edge: Refine Edge derives transparency and color in unknown regions; New Layer keeps both, whereas Mask or Selection keeps only transparency.
Based on official Photopea documentation read on October 23, 2026 (Asia/Shanghai). Examples and acceptance checks are proposed guidance, not hands-on software tests. Verify current controls in the intended browser.
Prepared by Imagild Editorial, the company editorial team responsible for these guides. AI assisted research and drafting. This is documentation-based guidance with proposed examples, not a claim of hands-on testing or an independent product review. Report a correction.
Cover: Rumeyda Tutak / Pexels, Pexels License. This is an illustrative source photograph, not an application screenshot or a generated test result.