You will also need to reset the New and Edit button -where overridden- to Use the Salesforce Classic override.
Navigate to Setup, then Object Manager.
Click the object name that has overridden New/Edit buttons.
From the left, click Buttons, Links and Actions.
Scroll to the Edit/New buttons that are overridden and, on the right, click the downward arrow, then Edit.
For any overridden properties, select No override/Use the Salesforce Classic override radio, so that properties look like below, then click Save.
Repeat steps 2-5 for any other remaining objects that have overridden New/Edit buttons.
You can then proceed by switching back to the Lightning mode and overriding the buttons from Classic override to the Lightning component.