The exclusionary rule is a judicial remedy to protect the constitutional rights of the Fourth Amendment. That means that the remedy is not found in the constitution itself, or in a statute, but was created by the Court. The rule was first developed by the United States Supreme Court, in exercising its authority over federal criminal prosecution. That is not our usual procedure for creating legal remedies. Generally there is a statute that spells out what fines or damages can be awarded, and how the determination shall be made.
Law derives from the Constitution and from statutes passed by legislators.
If you want it changed, go to the Legislature. Courts do not make law. They interpret it. But in the process of interpretation, of course, they flesh out and add to the body of law. Decisional law is a major component of the law.