If aa and bb are Real numbers with a < ba<b, then (a, b)(a,b) denotes an open interval, consisting of all values from aa up to bb, but not including aa and bb themselves.
[a, b][a,b] denotes a closed interval, consisting of all values from aa up to bb, including aa and bb themselves.
Other combinations are called half-open intervals, e.g.:
[a, b) = { x in RR : a <= x < b }
What about +-oo ?
First note that neither +oo (a.k.a. oo) nor -oo are Real numbers. Intuitively they lie beyond the ends of the Real number line, with +oo to the right and -oo to the left.
We can take the set of Real numbers RR and add these two objects as members to get the set RR uu { +-oo }. They cannot be incorporated fully into the arithmetic of the Real numbers, since expressions like oo - oo and 0 * oo are indeterminate. So they cannot fully be treated as numbers.
They can however be fully incorporated into the total order of the Real line, so that for any x in RR we have -oo < x < +oo.
So we can use the notation (0, oo) to denote all of the positive Real numbers.
Note that the notation (0, oo] is bogus in that it includes the 'value' +oo, unless you are specifically talking about RR uu { +-oo } rather than RR.
What about infinitesimals?
You can add infinitesimals and their reciprocals (which are infinite values) to the Real numbers RR in a way that is consistent with arithmetic and has none of the strangeness of +-oo.
There's a description of how at https://socratic.org/s/axhXNryX
What you end up with is called a totally ordered non-Archimedean field. Let's call it bar(RR).
Suppose epsilon is an infinitesimal in bar(RR). Then in some ways the interval [epsilon, oo) is similar to (0, oo). It includes all positive Real numbers - i.e. Real numbers greater than 0. However, it does not include all positive numbers in bar(RR). For example, it does not include epsilon/2.
Note that the interval [epsilon, 1/epsilon] is well defined in bar(RR) and also includes all positive Real numbers. It does not include all transfinite positive numbers in bar(RR), e.g. 2/epsilon !in [epsilon, 1/epsilon].