Skip to content

Adding NaN handeling to bolt#93

Open
boazmohar wants to merge 8 commits into
bolt-project:masterfrom
boazmohar:nan
Open

Adding NaN handeling to bolt#93
boazmohar wants to merge 8 commits into
bolt-project:masterfrom
boazmohar:nan

Conversation

@boazmohar

Copy link
Copy Markdown
Contributor

Continued work from #89
I think I better understand the need to add all the methods.
There is no numpy reducer equivalent to np.maximum or np.minimum that ignores NaNs instead of propagating them.
So you need to implement that in stats counter.
Added tests but a review would be most appreciated @jwittenbach, @freeman-lab

Comment thread bolt/spark/array.py Outdated
"""
return self._stat(axis, name='nanmin', keepdims=keepdims)

def nancount(self, axis=None, keepdims=False):

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i think we should drop this

-style changes
@mheppner

Copy link
Copy Markdown

Are there any updates on this? Is there anything I can do to help?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants