Olszewka was formerly part of the German Empire. In the German Empire, the place was called Olszewka.
The place is now called Olszewka and belongs to Poland.
| Historical place name | Country | Administration | Time |
|---|---|---|---|
| Olszewka | Russian Empire | Cehanov | 1914 |
| Olszewka | Poland | Ciechanów | 1919 |
| Olszewka | German Empire | Zichenau | 1939 |
| Olszewka | Poland | Ciechanów | 1945 |
| Olszewka | Poland | Ciechanów | 1992 |