Newton set out his "Rules of Reasoning in Philosophy" in Book III of Principia and they are still the basis for science.
Rule 1: We are to admit no more causes of natural things than such as
are both true and sufficient to explain their appearances.
Rule 2: Therefore to the same natural effects we must, as far as
possible, assign the same causes.
Rule 3: The qualities of bodies, which admit neither intensification
nor remission of degrees, and which are found to belong to all bodies
within the reach of our experiments, are to be esteemed the universal
qualities of all bodies whatsoever.
Rule 4: In experimental philosophy we are to look upon propositions
inferred by general induction from phenomena as accurately or very
nearly true, not withstanding any contrary hypothesis that may be
imagined, till such time as other phenomena occur, by which they may
either be made more accurate, or liable to exceptions.
They are still a pretty good basis for "doing science". Of course you can choose to ignore them, but the result of doing that is likely to be something different from the mainstream notion of "science".
Of course, following these principles doesn't make any conclusion "true". In fact Newton inadvertently gave an excellent example of that in his discussion of the principles in Principia itself, when he used the illustration that a coal fire on earth produces heat, and therefore following Rule 2 one should assume the heat of the sun is produced in the same way!