You might want to try flipping those around. Spoons are a high impact bait. They create a lot of flash and sound wave's. They really target the aggressive fish, that’s why they hit hardware so violently. But when you run that through a drift what you’re doing is forcing the fish to either strike, or move away from it.
Take a boulder patch in the summer. The fish are gunna be holding behind those boulders, using the choppy water as cover. Fish also like these spots because the food comes to them. A small bug gets washed out from under a rock and tumbles down the river. The fish holding in the calm water behind a boulder quickly moves out into the faster water, grabs the bug, and then pulls back behind the rock.
But if you run a spoon through that water, the fish is either gunna strike it or move away. Taking with it any chance you have of hooking him. Instead what you should start doing is start out with your smallest profile baits. Then proceed to bigger and more impactful baits like your spoon. That way you can run a jig through the run without having to worry about the fish spooking. If the fish doesn’t take your small profile bait then hit him hard with a high impact bait. If he doesn’t strike or moves away then, well he wasn’t gunna bite anything.