How broadly are you interpreting "astral projection?" Charles Dickens' A Christmas Carol (written in 1843, first filmed in 1935) has the spirits convey Ebenezer Scrooge through the walls of his bedroom to see visions of the past, present, and future.

In particular the Ghost of Christmas Present transports a disembodied Scrooge to the streets of London to witness how the "poor revellers" were celebrating Christmas:

...and they went on, invisible, as they had been before, into the suburbs of the town. It was a remarkable quality of the Ghost (which Scrooge had observed at the baker’s), that notwithstanding his gigantic size, he could accommodate himself to any place with ease; and that he stood beneath a low roof quite as gracefully and like a supernatural creature, as it was possible he could have done in any lofty hall.

Perhaps not what one traditionally considers sci-fi or fantasy, but A Christmas Carol does explore one man's encounter with extradimensional visitors. If nothing else it sets up the idea of a contemporary man learning from out-of-body experiences.

How broadly are you interpreting "astral projection?" Charles Dickens' A Christmas Carol (written in 1843, filmed as early as 1901 as "Scrooge, or, Marley's Ghost") has the spirits convey Ebenezer Scrooge through the walls of his bedroom to see visions of the past, present, and future.

In particular the Ghost of Christmas Present transports a disembodied Scrooge to the streets of London to witness how the "poor revellers" were celebrating Christmas:

...and they went on, invisible, as they had been before, into the suburbs of the town. It was a remarkable quality of the Ghost (which Scrooge had observed at the baker’s), that notwithstanding his gigantic size, he could accommodate himself to any place with ease; and that he stood beneath a low roof quite as gracefully and like a supernatural creature, as it was possible he could have done in any lofty hall.

The brief 1901 version apparently doesn't include the three spirits, instead relying on Bob Marley's ghost to provide the visions. But a 1908 version has the three spirits. Notably these early versions were early in the history of motion pictures; there's a long continuum stretching from stage performances to what we now think of as "movies."

Perhaps not what one traditionally considers sci-fi or fantasy, but A Christmas Carol does explore one man's encounter with extradimensional visitors. If nothing else it sets up the idea of a contemporary man learning from out-of-body experiences.