The title pretty much describes it. So, should I connect my older, weaker modem (which in its own can broadcast a wifi signals) to a new router that can broadcast much better through an Ethernet cable? If so, would the signals get better or would it stay the same?
Yes. Maybe turn off/disable the WiFi radio on your older modem so that the new router isn’t impacted by the radio noise from the old modem.