Hot crack usually happens during the welding process of 5083 aluminum alloy within its brittle temperature range due to excessive shrinkage stress. In this paper, the process of rolling during welding is studied to solve this problem. Based on the process of 5083 aluminum alloy sheet welding, the finite element model is established by the application of finite element software MSC. MARC, with the comprehensive considerations of the welding heat source model, material properties, rolling and other boundary conditions. By simulating the welding process, the residual stress of 5083 aluminum alloy sheet is compared with conventional welding rolling, and the residual stress of the welded parts is compared based on different rolling parameters. The calculation results show that the residual stress can be effectively reduced by choosing appropriate distance between the wheel and gun and sinking amount in the process of rolling during welding.