How can we search for box drive documents using windows explorer or general windows search

You actually have to have the app running, though. If you end the task, or disable it at startup, you'll have to open it first and give it a minute to connect.

Open your Windows Explorer and as long as the app is downloaded you can add it to your favorites. It should automatically be there. Double-click on it and you will have access to your files.