Some numbers are clearly associated with the enemy and I imagine the Gods are less likely to use these for communications. Other numbers should be thought of as neutral, although any signs you receive are based on your interpretation of them.
Overall, numbers are neutral and it shouldn't be considered that the enemy "owns them", just that they abuse them. HPHC had written more on this.