使用OpenCV将一个纯绿色区域替换为另一幅图像

Question

下面的图像有一个绿色区域，我正在寻找任何其他图像替换。它的视角没有必要匹配。你知道吗

我已经可以制作一个面具了。但在调整另一幅图像的大小并将其与绿色区域对齐方面还没有取得成功。我在网上找到的大多数资源都提到了这两幅图像需要相同的大小，但我只想调整新图像的大小，使其适合绿色矩形，而不是让两幅正方形图像重叠，其中一幅图像带有剪切。你知道吗

什么是好方法？你知道吗

Answer 1

根据我前面的答案的评论，这里有一个简单的缩放和平移仿射扭曲的方法。你知道吗

Read both images

Measure the height of the green region and get the height of the src image

Measure the center (x,y) of the green region and get the center of the src image

Compute the affine matrix coefficients for scale and translation only (no rotation or skew)

Warp the source image using the affine matrix   the background will be black

Create a binary mask from the warped src image making everything not black into white

Invert the mask

Apply the inverted mask to the dst image

Add the warped src over the masked dst to form the result

src公司：

夏令时：

#!/python3.7

import cv2
import numpy as np


# Read source image.
src = cv2.imread('original.jpg')
h_src, w_src = src.shape[:2]

# Read destination image.
dst = cv2.imread('green_rect.png')
h_dst, w_dst = dst.shape[:2]

# compute scale from height of src and height of green region
h_green=170
scale = h_green/h_src

# compute offsets from center of scaled src and center of green
x_src = (scale)*w_src/2
y_src = (scale)*h_src/2
x_green = 165
y_green = 140
xoff = (x_green - x_src)
yoff = (y_green - y_src)

# build affine matrix for scale and translate only
affine_matrix = np.float32([ [scale,0,xoff], [0,scale,yoff] ])

# do affine warp
# add 1 to src to ensure no pure black
src_warped = cv2.warpAffine(src+1, affine_matrix, (w_dst, h_dst), cv2.INTER_AREA)

# Compute mask (roi) in warped src
_, mask = cv2.threshold(src_warped,1,255,cv2.THRESH_BINARY)

# Invert single channel of mask
inv_mask = cv2.bitwise_not(mask[:,:,0])

# Mask dst with inverted mask
dst_masked = cv2.bitwise_and(dst, dst, mask=inv_mask)

# Put warped src over masked dst
result = cv2.add(dst_masked,src_warped)

# Save outputs
cv2.imwrite('warped_src.jpg', src_warped)
cv2.imwrite('masked_src.jpg', mask)
cv2.imwrite('affine_composite.jpg', result)

翘曲钢筋：

反转遮罩：

屏蔽dst

结果：