Doesn't work.

#issue On a sidenote, probably unrelated: cmd+A (select everything) doesn't work either.

It generates db.bind("postgres", host="", user="", password="", database="") Instead of db.bind("postgres", host="postgres", user="user", password="password", database="tags")

Doesn't work.

Fixed

fixed

If I set sql_default="NOW()" for a datetime column, do I have to set volatile=True?

Well, the default will be applied to insert only. But if you plqn to create object and to continue work with it in the same transaction, then probably yes

Okey.

ApiKey.exists(id=api_key) (id is type UUID) raises: File "/app/src/pony/pony/orm/dbapiprovider.py", line 726, in validate return UUID(hex=val) File "/usr/local/lib/python3.5/uuid.py", line 140, in __init__ raise ValueError('badly formed hexadecimal UUID string') ValueError: badly formed hexadecimal UUID string Shouldn't it just return False?

Can pony orm handle Enums in postgres? https://www.postgresql.org/docs/9.1/static/datatype-enum.html

Can pony orm handle Enums in postgres? https://www.postgresql.org/docs/9.1/static/datatype-enum.html

Would they use Python enums? Because Python enums are.. interesting.

Would they use Python enums? Because Python enums are.. interesting.

Yeah, in python I still use FOO = 1 BAR = 2

hi, is there a problem with editor.ponyorm.com ?

I think it is up

If you manually change plural to 'Jobs', after that it should follow again

thank you

should be fixed now

Hello! class Molecule(db.Entity): _table_ = (schema, 'molecule') id = PrimaryKey(int, auto=True) children = Set('Molecule', reverse='parent', cascade_delete=True) parent = Optional('Molecule', reverse='children') merge_source = Set('Molecule', reverse='merge_target') # molecules where self is more correct merge_target = Set('Molecule', reverse='merge_source') # links to correct molecules how to set schema for many-to-many table?

I try to implement DB for storing chemical reactions and molecules with versioning of structure

You can specify 'table' option for any Set attribute of many-to-many relationship: merge_source = Set('Molecule', table=['schema_name', 'table_name'])

Thank you!

Still missing size=64 for ints, and sql_default='NOW()' for datetimes

Try now @luckydonald size for ints and sql_default options have been added

Yeah, working! Awesome!

And again forgot to log in before editing :/ Lets do it again :D

If I set sql_default="NOW()" will the datetime field be loaded after creation? Somehow how I imagine auto=True [0] to work. The volatile=True [1] allows the database to be changed outside of pony, but does it mean, this is less efficient, because it need to check that field every time I used it (read/write)? [0] https://docs.ponyorm.com/api_reference.html?highlight=size#cmdoption-arg-auto [1] https://docs.ponyorm.com/api_reference.html?highlight=size#cmdoption-arg-volatile

How do I put text[] type in ORM? http://www.monkeyandcrow.com/blog/tagging_with_active_record_and_postgres/ https://www.postgresql.org/docs/9.6/static/arrays.html

If I set sql_default="NOW()" will the datetime field be loaded after creation? Somehow how I imagine auto=True [0] to work. The volatile=True [1] allows the database to be changed outside of pony, but does it mean, this is less efficient, because it need to check that field every time I used it (read/write)? [0] https://docs.ponyorm.com/api_reference.html?highlight=size#cmdoption-arg-auto [1] https://docs.ponyorm.com/api_reference.html?highlight=size#cmdoption-arg-volatile

Volatile attribute values are cached too, but when object is inserted or updated Pony forget values of volatile attributes and should re-read them if the attribute value requested in the same db_session after insert/update. It is a bit less efficient then auto=True, but if you dont't change object too often, the difference should not be too big. For datetme attribute it is possbile to use Python datetime.now default value instead of NOW() SQL function, but it has some limitations. If you use Python's datetime.now default, it is better to store time in UTC timezone.

How do I put text[] type in ORM? http://www.monkeyandcrow.com/blog/tagging_with_active_record_and_postgres/ https://www.postgresql.org/docs/9.6/static/arrays.html

Right now Pony does not support PostgreSQL arrays, but in many cases you can use JSON arrays instead, which are supported by Pony.

Bummer. Are json lists as performant? Trying to improve my tagging system, as it has become to slow for answering telegram inline queries in time... I wanted to try out http://www.monkeyandcrow.com/blog/tagging_with_active_record_and_postgres/

I think json lists should be almost as performat as arrays. But in my opinion, neither json lists nor arrays will improve the performance of your query, because it is inherently slow, especially if you want to use in instead of startswith for tag name search. If I'd write such an application, I'd search tags in Python, and then pass found list of tag's ids to the database. To do that, I'd write a python function which accept a substing and return a set of tag ids which names contain that substring: tag_cache = defaultdict(set) # substring -> set(tag_id) @db_session def populate_tag_cache(): for tag in Tag.select(): string = tag.string.lower() for i in range(0, len(string)): for j in range(i+1, len(string)): substing = string[i:j] tag_cache[substring].add(tag.id) def find_tags(substring): return tag_cache[substring.lower()] def find_stickers(query_text): query_text = query_text.lower() tag_ids = find_tags(query_text) - find_text("nsfw") pairs = orm.select( (st.sticker.file_id, max(st.date)) for st in StickerMessage if ( orm.exists(s_t for s_t in st.sticker.tags if s_t.id in tag_ids) or orm.exists(p_t for p_t in st.sticker.sticker_pack.tags if p_t.d in tag_ids) ) ) This is not a complete code (I have no time to help you write entire application), but just a rough idea. I think that for real-time search you should use pre-calculated cache sitting in Python memory and use tha cache to calculate list of tags without hitting the database. But you will need to update cache manually when you add new tags. This complicates architecture, but improves performance

I think json lists should be almost as performat as arrays. But in my opinion, neither json lists nor arrays will improve the performance of your query, because it is inherently slow, especially if you want to use in instead of startswith for tag name search. If I'd write such an application, I'd search tags in Python, and then pass found list of tag's ids to the database. To do that, I'd write a python function which accept a substing and return a set of tag ids which names contain that substring: tag_cache = defaultdict(set) # substring -> set(tag_id) @db_session def populate_tag_cache(): for tag in Tag.select(): string = tag.string.lower() for i in range(0, len(string)): for j in range(i+1, len(string)): substing = string[i:j] tag_cache[substring].add(tag.id) def find_tags(substring): return tag_cache[substring.lower()] def find_stickers(query_text): query_text = query_text.lower() tag_ids = find_tags(query_text) - find_text("nsfw") pairs = orm.select( (st.sticker.file_id, max(st.date)) for st in StickerMessage if ( orm.exists(s_t for s_t in st.sticker.tags if s_t.id in tag_ids) or orm.exists(p_t for p_t in st.sticker.sticker_pack.tags if p_t.d in tag_ids) ) ) This is not a complete code (I have no time to help you write entire application), but just a rough idea. I think that for real-time search you should use pre-calculated cache sitting in Python memory and use tha cache to calculate list of tags without hitting the database. But you will need to update cache manually when you add new tags. This complicates architecture, but improves performance

Thank you for your feedback, Im sure to have a look later!

what front end framework would you guys suggest for flask?

i was using semantic-ui but.. ehh

I dabble in a bit of everything. Many people swear to react nowadays, though.

i was looking into react, i just wish there was a python response to react

thank you

XZ x n8 v b vcvheeec 8. e bcxvbb c D u c. out boxeo rcio st 6 y. dcbc xS x 8 bcxD 3 za x x x vi cbc 6 xc 68 b 5, Z tey Unix c. 0 8 6.

I think json lists should be almost as performat as arrays. But in my opinion, neither json lists nor arrays will improve the performance of your query, because it is inherently slow, especially if you want to use in instead of startswith for tag name search. If I'd write such an application, I'd search tags in Python, and then pass found list of tag's ids to the database. To do that, I'd write a python function which accept a substing and return a set of tag ids which names contain that substring: tag_cache = defaultdict(set) # substring -> set(tag_id) @db_session def populate_tag_cache(): for tag in Tag.select(): string = tag.string.lower() for i in range(0, len(string)): for j in range(i+1, len(string)): substing = string[i:j] tag_cache[substring].add(tag.id) def find_tags(substring): return tag_cache[substring.lower()] def find_stickers(query_text): query_text = query_text.lower() tag_ids = find_tags(query_text) - find_text("nsfw") pairs = orm.select( (st.sticker.file_id, max(st.date)) for st in StickerMessage if ( orm.exists(s_t for s_t in st.sticker.tags if s_t.id in tag_ids) or orm.exists(p_t for p_t in st.sticker.sticker_pack.tags if p_t.d in tag_ids) ) ) This is not a complete code (I have no time to help you write entire application), but just a rough idea. I think that for real-time search you should use pre-calculated cache sitting in Python memory and use tha cache to calculate list of tags without hitting the database. But you will need to update cache manually when you add new tags. This complicates architecture, but improves performance

Had a thought about that. Currently I already have `1331` unique tags, not sure if that could hit memory very fast. I had a talk with a guy maintaining a big image board, where tagging and complex queries are a big thing. He said, he copies relevant tag data into elastic search and use its power of full text search and bool filtering. As soon as a tag is change it is notified to a redis based task scheduler and processed in background every 2 seconds

I want to be able to send blog posts to my site from a little PyQt app that I wrote. What would be the safest way to confirm that I sent the post?

Right now I'm thinking about encrypting my secret key and sending it with the json packet which gets turned into a post, but I don't know enough about crypto to know if thats a good idea.

Use https

Let's encrypt free

I know, this is probably the wrong group, but you guys know python so well :D Anyone knows a python substitution for sidekiq/redis ("simple background processing for Ruby")? I came along RQ ("Redis Queue") http://python-rq.org/ (via https://devcenter.heroku.com/articles/python-rq )

Ah well, Might have to research further what exactly I need

Hello everyone. Any direction to create a postgres database if it doesn't exist? (from within pony)

Hello everyone. Any direction to create a postgres database if it doesn't exist? (from within pony)

Hi Romain, welcome Currently there is no way to create a postgres database from Pony - you only can create tables and indexes if they don't exist. The database itself should be created before it can be used in Pony.

OK many thanks for the welcome and the tip

I use RQ

Rq?

By the way any news on migration?

The migration tool is almost ready. I really hope we can release before the end of this week. But I want to be sure it does not contain bugs, so we don't receive a flood of messages "the migration tool broke my tables"

The migration tool is almost ready. I really hope we can release before the end of this week. But I want to be sure it does not contain bugs, so we don't receive a flood of messages "the migration tool broke my tables"

i'm happy with that

Excellent news!

Hi everyone! I've started using Pony yesterday and haven't actually understood how to use joins yet. In examples I saw when left_join() was used with two for clauses, but when I try to repeat it in my code, I get error like "collection was expected, got "for p in Pond"" Maybe somebody could explain how to use it or point me to docs page where it's already explained?

Hi Mark! That's a great question, and I'm going to give explanation now. But could you give me a favor? Ask this question at http://stackoverflow.com/questions/tagged/ponyorm, so this answer would be available for all people who will look for it. Thanks

ok, great!

http://stackoverflow.com/questions/41847908/pony-orm-join-syntax

Ok, give me a few minutes

Still no answer :(

Done: http://stackoverflow.com/questions/41847908/pony-orm-join-syntax/41849887#41849887

Thank you very much!

In that case it will be three queries, but still much less than N+1

The first query is to retrieve persons, the second one is to retrieve contacts of the first person, and the third one is to retrieve contacts of all other loaded persons

Ok, cool. And is there a way to write a query similar to this: SELECT * FROM "public"."person" "p" LEFT JOIN "public"."contacts" "c" ON "p"."id" = "c"."person"

like, select all of columns from joined table

No, Pony does not support such queries, because they are less efficient. In query like this, the same person data will be appeared multiple times, and need to be processed in Python again and again during data retrieving. In most cases it is better to split this query to two where each retrieve data without any unnecessary duplication

Ok, thank you very much!

Sure! If you think that StackOverflow answer is on-point, then please mark it as accepted )

oh, sorry, of course

Thanks!

Hi guys, i just started using ponyorm through my telegram bot

I have no idea how to store date, I always get error, I think my date format from python was rigth

Anyone know to deal with this ? Sorry for silly question

Can you give an example of how you do it?

that is my entity

that is the function that I use to passing the data

And what is the error?

the error come from the framework (telegram-bot not pony), but from what i learned before, it caused by wrong datatype input

I want to pass yyyy-mm-dd format to date type, is it possible ?

If score is an instance of Score, then score.taken would be instance of date. If you want to get a date in format of yyyy-mm-dd, you can use isoformat method of date object: score.taken.isoformat()

Thanks sir, I'll try it

If score is an instance of Score, then score.taken would be instance of date. If you want to get a date in format of yyyy-mm-dd, you can use isoformat method of date object: score.taken.isoformat()

Sir, I found the actual problem, the "max" option on my Score entity doesn't work. I checked on my mysql table, I get int(11) not int(2) as I expected

max option allows to check value assigned to the attribute in Python. If you specify that max=2 that means that the value may be 0, 1, 2, -1, -100, etc., but no greater then 2